“… Respondents were recruited on the street and were first asked a number of screening questions. Three of these questions were whether the potential respondents had purchased or looked into the purchase of flowers in the previous two to three years; whether they had undertaken activities on the internet but were not confident about creating a web page; and whether they were in a position to read a computer screen. Some 95 respondents passed the screening test, and were chosen to answer further questions. They were brought into a hall set up with four laptop computers. Each participant was asked to type the word ‘Interflora’ into the search box on the Google homepage. It was not a real Google search, because each computer was set up so as to display one of the search results pages which are the subject of this litigation. The search results page brought up Interflora, both as a natural or organic result and also as a sponsored link. The search results page also brought up an M & S sponsored link, quoted above, together with other sponsored links. Participants were then invited to scroll up and down the page and to tell the interviewer when they were ready to answer questions. Once ready each participant was asked a series of structured questions. These questions were changed during the course of the survey. The questions did not distinguish between natural or organic results on the one hand and sponsored links on the other. The questions were framed generically by reference to ‘results’ or ‘search results’. … In the first survey [question 6] was posed as follows: ‘Thinking specifically about this search result (POINT to MARKS & SPENCER RESULT). What if anything do you think this tells you about any relationship between Interflora and Marks and Spencer?’”
“Mr Hobbs' macro objection is that the court should not permit evidence to be adduced from witnesses selected as a result of a survey unless the survey itself is statistically reliable. It does not matter whether such evidence is technically admissible, because the court has power underCPR 32.1 (2) to exclude evidence that is otherwise admissible. The argument runs thus: i) The question at issue is whether the reasonably well-informed and reasonably observant internet user would or would not understand the M & S advertisement to indicate that M & S was part of the Interflora network. ii) The reasonably well-informed and reasonably observant internet user is not a real person. He or she is a legal construct. As the Court of Justice made clear, the fact that some internet users may have had difficulty grasping that the service provided by M & S is independent from that of Interflora is not a sufficient basis for a finding that the function of indicating origin has been adversely affected. iii) Accordingly, simply to call some internet users to give evidence is not probative of the issue in the case. iv) That evidence can only be probative if those who are called can in some way be seen to stand proxy for the legal construct through whose eyes the essential question must be judged. v) Unless the survey used for witness collection is itself a reliable survey, the court will have no means of knowing whether the selected witnesses can be treated as reliable proxies for this legal construct. The problem is compounded where, as here, the party calling the witnesses is permitted to select those who give most support to its case. vi) Even if the evidence of such witnesses is, in principle, admissible, it is likely to be of such marginal utility and so expensive and time consuming to collect, analyse and deal with in court, that the court ought to exclude it in exercise of its powers underCPR Part 1.4 (2) (h) andCPR Part 32.1 .”
“I stress again that what is in issue is the effect on a hypothetical legal construct: the reasonably well-informed and reasonably observant internet user. In the absence of special circumstances, how can calling ten, twenty or thirty witnesses selected from a statistically invalid survey be extrapolated into the effect on that legal construct of the advertisement or sign in issue?”
“The proposal in the present case is not quite as dire as the second possibility discussed in Arnotts because Interflora have disclosed all the answers to the questionnaires. But the remaining objections [mentioned by the Federal Court] still hold good: viz. that the selected witnesses are not (or at least cannot be shown to be) a fair sample of the class of reasonably well-informed and reasonably observant internet users, with the consequence that there is no ground for any extrapolation on a statistical basis, or on the basis of any mathematical or logical probability, of the views of the selected witnesses as representing the effect of the M & S advertisement on the hypothetical reasonably well-informed and reasonably observant internet user. If evidence of this kind cannot form the basis for extrapolation on the basis of any mathematical or logical probability leading to a conclusion about the effect of M & S's advertisement on the hypothetical reasonably well-informed and reasonably observant internet user, then in the absence of special circumstances it cannot be useful. And if it cannot be useful, it should not be allowed to distract the focus of the trial even if it is technically admissible.”
“The upshot of this review is that courts have allowed the calling of evidence of the kind that Interflora wishes to call and have considered it, either in conjunction with or in the absence of a statistically valid and reliable survey. But it is generally of little or no value. Sometimes it does no more than confirm the conclusion that the judge would have reached without the evidence. In passing off cases it sometimes has greater effect, but as I have said more than once, passing off raises a different legal question. Unless the court can be confident that the evidence of the selected witnesses can stand proxy for the persons or construct through whose perception the legal question is to be answered it simply represents the evidence of those individuals. In a case in which the witnesses are called in order to amplify the results of a statistically reliable survey their evidence may be probative. But unless the court can extrapolate from their evidence, it is not probative.”
“I consider that, even if the evidence is technically admissible, the judge should not let it in unless (a) satisfied that it would be valuable and (b) that the likely utility of the evidence justifies the costs involved.”
“In the present case I do not consider that Interflora has demonstrated that the evidence it wishes to call would be of real value. To put it bluntly, Interflora starts with an unreliable dataset from which it proposes to select the witnesses most favourable to itself.”
“154. … It will be recalled that one of the concerns expressed in the Whitford guidelines is that questions might lead a witness into a field of speculation upon which that person would never have embarked had the question not been put. That can be seen to have happened in this case. I give some examples, all taken from the answers to question 6 in the first questionnaire (‘Thinking specifically about this search result (POINT to MARKS & SPENCER RESULT). What if anything do you think this tells you about any relationship between Interflora and Marks and Spencer?’): … 155. Mr Hobbs also pointed to a number of answers that either showed that the respondent drew nothing from the results, or appreciated that there was no link between Interflora and M & S. Again I give examples of responses to the first questionnaire … 156. It would be tedious to multiply examples. I simply fail to see how against that background calling a selection of witnesses would advance the case that Interflora wants to make.”
“Have you used the internet to search for information about goods or services in the last year? Yes/No/Can’t remember When you used the internet last year, did you use a search engine to search for ‘Interflora’? [A short explanation of the terms “search engine” was provided.] Yes/No/Can’t remember Which search engines have you used to search for ‘Interflora’? A list of 10 of which Google was the fourth Thinking about when you have searched for Interflora using Google, do you remember any search results for websites other than Interflora? Yes/No/Can’t remember Which links to websites do you remember seeing on the search results page? A list of nine of which “M&S” was the first and “Don’t know/can’t remember” the last We are interested in how people have used search engines to look for the Interflora website and the experience they had. If you are happy to be contacted by Interflora about the answers you have provided in this survey, please click this box and complete your contact details below.”
“2. I use the internet quite a lot. I use it every day at work for emails. I also use it a lot personally for email, Facebook, researching and buying things online. The time I properly shopped online was probably last Christmas, but I did book and pay for MOT online. I’m always moving money around using online banking so it feels like I’m shopping! 3. I remember that a friend of mine was in hospital earlier this year and I wanted to send her some flowers after she came out of hospital. I used the internet to order the flowers. I trust Interflora to be good quality and provide same day delivery service so I decided to use them. Off the top of my head they were the only ones I could get through to quickly who would do same day delivery. 4. I wanted to order the flowers online because it was more convenient. To get to the Interflora site I went to the Google page to search for ‘interflora’. When I put ‘interflora’ into Google, I clearly remember M&S coming up on the search results page, together with other companies but I can’t recall what they were. 5. When I saw the M&S search result, I thought that there must be some supermarkets which also do online flowers. I thought if I went through the M&S site I would still get Interflora flowers. I know that some companies probably act as agents for a company like Interflora. However, I wanted to make sure I got Interflora flowers direct and I trust the delivery service so I went through the official Interflora site.”
“The need for circumspection in the assessment of questionnaire survey evidence is well-understood. The concern is that to a greater or lesser degree: ‘Interviews and questionnaires intrude as a foreign element into the social setting they would describe, they create as well as measure attitudes, they elicit atypical roles and responses, they are limited to those who are accessible and will co-operate and the responses obtained are produced in part by dimensions of individual differences irrelevant to the topic at hand’ Webb, Campbell, Schwartz and Sechrest, Unobtrusive Measures (revised edition, Sage Publications Inc, 2000). There is, accordingly, a practical requirement for information relating to the structure, method and results of questionnaire surveys to be full enough to enable the strengths and weaknesses of the research work to be evaluated.”
“From your memory of these search results, what, if anything, do you think this tells you about any relationship between Interflora and M&S?”