“There must be something much more than that. There must be something which can fairly amount to his doing the act complained of or allowing the act complained of, either by actual participation by himself or his agents or by what Lord Collins called active participation in that which was complained of.”