The html was (with <> encapsulation) meta name=‘Googlebot’ content=‘nofollow’ /
Not all of the devices get crawled, only a subset. I don’t know how google got wind of them. I want google to “forget” the urls, rather than not crawl them
We added a robots.txt to the root of agents.electricimp.com by the way - Google seems to have honored it and stopped displaying the few agent URLs that were indexed.