“It has come to the attention of the Home Office, from information provided by Educational Testing Service (ETS) that an anomaly with your speaking test indicated the presence of a proxy test taker … In light of this information it is the considered opinion of the Home Office that you have utilised deception to gain leave to remain in the United Kingdom.”
“You are specifically considered a person who has sought leave to remain in the United Kingdom by deception. For the purposes of your application dated04 November 2013 , you submitted a TOEIC certificate from [ETS] to the Home Office and your sponsor in order for them to provide you with a Confirmation of Acceptance for Studies [a so-called “CAS” certificate]. … ETS has a record of your speaking test. Using voice verification software, ETS is able to detect when a single person is undertaking multiple tests. ETS undertook a check of your test and confirmed to the SSHD that there was significant evidence to conclude that your certificate was fraudulently obtained by the use of a proxy test taker. Your scores from the test taken on28 August 2013 at Eden College International have now been cancelled by ETS.”
“On the basis of the information provided to her by ETS, the SSHD is satisfied that there is substantial evidence to conclude that your certificate was fraudulently obtained.”
“Everyone taking the exam spoke loudly and it sounded like I was in a pub as we were all speaking at the same time.”
“….. In relation to ETS test centres, individuals were able to pay to pass the English language test. Proxy test takers were seen taking the speaking element of the test and answers were seen read out from the front of a class supposedly taking a multiple choice element of the test.”
“Following the provision of this data the Home Office had a teleconference with ETS on 01 April [2014]. The discussion focused on the first batch of test analysis. ETS described that any test categorised as cancelled (which later became known as invalid) had the same voice for multiple test takers. On questioning they advised that they were certain there was evidence of proxy test taking of impersonation in those cases.”
“We recognised that where ETS had cancelled a test score because of impersonation and proxy test taking that test score had been obtained by deception. We further recognised that persons in that position who then used that test score had sought to obtain leave by deception.”
“Where the details of the certificate on the Home Office file matched those provided in the data from ETS as an invalid result, we undertook a consideration of all relevant factors (including for example possible human rights grounds) which might mean that removal was not appropriate. Where no such circumstances existed, we took a decision to remove the applicant …. under section 10(1)(b) ….”
“The basic technology extracts biometric features from an individual’s speech to generate voice print (the voice equivalent of a finger print). This voice print can then be run against samples to establish whether the sample is likely a recording of the same person who had generated the voice print or a different person.”
“The results …. were that matching samples produced values that were higher than values from the non-matching samples the majority of the time, with a less than 2% error rate …. ETS accepted that voice biometric technology is currently imperfect … too many false positives would fatally undermine the integrity of the voice biometric system ….”
“The electronic files generated at the testing stage required a two step audio conversion process ………..”
“Tests from a test centre were batched into groups of 300 – 400 test takers … These audio files were then run through the voice biometrics engine. Each batch would take approximately two hours to process. The engine would compare each test to all other tests in that batch and flag all suspicious results (those that were a ‘match’) in line with the probability thresholds discussed above. The output would be a list of flagged cases ranked in order of the most likely match through to least likely.”
“They [ETS] acknowledged that the technology they used was imperfect and that samples could be incorrectly flagged as matches (ie false positives). This could occur due to noise in the background of a recording (eg an air conditioning system) or the detection of another noise in the background which matches another test taker (although ETS notes that test takers should not be sitting so close to one another that they can overhear each other’s responses).”
“It was very clear to me, from the samples I heard, that those samples were of the same person speaking. I was able to compare tone, accent and the distinctive and instinctive expressions used to fill hesitations in speech.”
“During the demonstration, the senior analyst advised that the OTI were constantly updating their guidance and sharing information to ensure that analysts could hone their skills. For example, they shared the distinctive use of particular idioms, verbal tics and/or answers being structured in exactly the same way between test takers. We were also advised that, in order to maintain accuracy, analysts were encouraged to take regular breaks and every effort was taken to avoid an analyst dealing with the same testing centre or the same questions repetitively.” [My emphasis.] There is an unmistakable self-serving element in the averments which follow: “ETS statistics bear out the underlying reliability of the voice biometrics technology. Of over 33,000 possible matches identified by the system 80% were confirmed after human verification. As already discussed, many of these ‘non-verified matches’ would have been because of the presence of noise in the background of recordings. The analysts adopt an approach whereby any doubt about the validity of a match will result in it being rejected. I am confident this mitigates significantly against the risk of a false positive.”
“ETS have identified thousands of cases where speech samples display marked similarities, leading OTI to believe an imposter was involved and in such cases scores will be cancelled. Within the tests analysed the OTI has identified many instances where the speech sample indicates the same individual has taken tests in place of numerous candidates. Where a match has been identified their approach is to invalidate the test result … ETS has informed the Home Office that there was evidence of invalidity in those cases.”
“Where a match has not been identified and verified, an individual’s test result may still be invalidated on the basis of test administration irregularity including the fact that their test was taken at a UK testing centre where numerous other results have been invalidated on the basis of a ‘match’. In those cases the individual would usually be invited to take a free re-test. These cases are clearly distinguished by ETS in its spreadsheets provided to the Home Office from tests where there is substantial evidence of invalidity.”
“Analysing different aspects of the voice and speech patterns found in a recording. The profiles of the features that are found are then compared across the recordings. The analysis process usually takes between 10 and 15 hours for a comparison of two samples.” (ii) The editing of audio files prior to expert analysis is standard practice. (iii) Segmental analysis of speech samples is carried out in accordance with the methodology approved by the International Phonetic Association and is designed to identify the “fine-grained nuances of speech”. (iv) The mechanics of analysing voice quality, pitch, intonation, rhythm and tempo form part of the exercise. (v) In appropriate cases, it is also necessary to examine patterns of language and grammar or to undertake acoustic-phonetic analysis or other specified forms of analysis. (vi) Automatic speaker recognition systems have the modus operandi of “[taking] the recorded voices of individuals, [performing] complex mathematical operations on them and [reducing] them to statistical representations or models.” (vii) “The results produced by automatic systems are numeric scores which reflect the degree of similarity between two samples – larger numbers reflect great similarity and smaller numbers reflect a greater dissimilarity between samples ….. Changing the threshold alters the errors rates of the system since results from some pairs will change from a yes to a no or vice-versa ….. as the threshold increases the false negative error rate increases whilst the false positive error rate decreases …. Therefore the choice of threshold is crucial in determining the errors rates and performance of the system”. (viii) Thus under automatic speaker comparison systems both false positives and false negatives are possible, with the consequence that “for a quoted error rate to be meaningful, the type of error that it refers to must be stated”
“… although the analysts only verified matches where they had no doubt about their validity – ie where they were certain about their judgments – this should not be taken as a reliable indicator of the accuracy of those judgments. This approach does not remove the risk of false positive results.”
“(1) A person who is not a British citizen may be removed from the United Kingdom, in accordance with directions given by an immigration officer, if- (a) having only a limited leave to enter or remain, he does not observe a condition attached to the leave or remains beyond the time limited by the leave; (b) he uses deception in seeking (whether successfully or not) leave to remain; or (ba) his indefinite leave to enter or remain has been revoked undersection 76(3) of the Nationality, Immigration and Asylum Act 2002 (person ceasing to be refugee); (c) directions have been given for the removal, under this section, of a person to whose family he belongs. (2) Directions may not be given under subsection (1)(a) if the person concerned has made an application for leave to remain in accordance with regulations made under section 9. (3) Directions for the removal of a person may not be given under subsection (1)(c) unless the Secretary of State has given the person written notice of the intention to remove him.” (8) When a person is notified that a decision has been made to remove him in accordance with this section, the notification invalidates any leave to enter or remain in the United Kingdom previously given to him.”
“However I am satisfied that this evidence is in effect generic and does not show the exact reason why ETS invalidated the certificate of the Appellant in particular and provides no evidence relating to the Appellant’s personal circumstances.”
“The ETS themselves actually confirm in writing that there are multiple reasons for invalidation, some of which may not involve fraud or deception.”
“….. The Respondent had failed to comply with directions of the Tribunal by not providing evidence relating to the Appellant’s particular English language test and related documents ….”
“The evidence of deception should be clear and unambiguous in order to initiate action under section 10. Where possible, original documentary evidence, admissions under caution or statements from two or more witnesses should be obtained which substantiate that an offence has been committed before authority is given to initiate action under section 10 …. The evidence must always prove to a high degree of probability that deception had been used to gain the leave, whether or not an admission of deception is made. The onus – as always in such situations – is on the officer making the assertion to prove his case.”
“The above analysis and the conclusion it yields, namely that the Applicant can pursue an out of country appeal, do not lead inexorably to the conclusion that permission must be refused. This is so because, as acknowledged above, the effect of the relevant jurisprudence is that an application for judicial review of an appealable immigration decision lies where the test of special or exceptional factors is satisfied …. The out of country appeal available to the Applicant is, presumptively, an adequate alternative remedy. The displacement of this presumption will, in any given case, require suitable evidence.”
“Bad faith is a serious allegation which attracts a heavy burden of proof.”