{"id":133458,"date":"2019-05-13T12:00:52","date_gmt":"2019-05-13T11:00:52","guid":{"rendered":"https:\/\/www.transcend.org\/tms\/?p=133458"},"modified":"2023-06-20T05:59:05","modified_gmt":"2023-06-20T04:59:05","slug":"swarms-of-drones-piloted-by-artificial-intelligence-may-soon-patrol-europes-borders","status":"publish","type":"post","link":"https:\/\/www.transcend.org\/tms\/2019\/05\/swarms-of-drones-piloted-by-artificial-intelligence-may-soon-patrol-europes-borders\/","title":{"rendered":"Swarms of Drones, Piloted by Artificial Intelligence, May Soon Patrol Europe\u2019s Borders"},"content":{"rendered":"
\"\"<\/a>

Illustration: Soohee Cho\/The Intercept<\/p><\/div>\n

11 May 2019 – <\/em>Imagine you\u2019re hiking through the woods near a border. Suddenly, you hear a mechanical buzzing, like a gigantic bee. Two quadcopters have spotted you and swoop in for a closer look. Antennae on both drones and on a nearby autonomous ground vehicle pick up the radio frequencies coming from the cell phone in your pocket. They send the signals to a central server, which triangulates your exact location and feeds it back to the drones. The robots close in.<\/p>\n

Cameras and other sensors on the machines recognize you as human and try to ascertain your intentions. Are you a threat? Are you illegally crossing a border? Do you have a gun? Are you engaging in acts of terrorism or organized crime? The machines send video feeds to their human operator, a border guard in an office miles away, who checks the videos and decides that you are not a risk. The border guard pushes a button, and the robots disengage and continue on their patrol.<\/p>\n

This is not science fiction. The European Union is financing a project to develop drones piloted by artificial intelligence and designed to autonomously patrol Europe\u2019s borders. The drones will operate in swarms, coordinating and corroborating information among fleets of quadcopters, small fixed-wing airplanes, ground vehicles, submarines, and boats. Developers of the project, known as Roborder, say the robots will be able to identify humans and independently decide whether they represent a threat. If they determine that you may have committed a crime, they will notify border police.<\/p>\n

President Donald Trump has used the specter of criminals crossing the southern border to stir nationalist political sentiment and energize his base. In Europe, two years after the height of the migration crisis that brought more than a million people to the continent, mostly from the Middle East and Africa, immigration remains a hot-button issue, even as the number of new arrivals has dropped. Political parties across the European Union are winning elections on anti-immigrant platforms<\/a> and enacting increasingly restrictive border policies<\/a>. Tech ethicists and privacy advocates worry that Roborder and projects like it outsource too much law enforcement work to nonhuman actors and could easily be weaponized against people in border areas.<\/p>\n

\u201cThe development of these systems is a dark step into morally dangerous territory,\u201d said Noel Sharkey, emeritus professor of robotics and artificial intelligence at Sheffield University in the U.K. and one of the founders of the International Committee for Robot Arms Control, a nonprofit that advocates against the military use of robotics. Sharkey lists examples of weaponized drones currently on the market: flying robots equipped with Tasers, pepper spray, rubber bullets, and other weapons. He warns of the implications of combining that technology with AI-based decision-making and using it in politically-charged border zones. \u201cIt\u2019s only a matter of time before a drone will be able to take action to stop people,\u201d Sharkey told The Intercept.<\/p>\n

Roborder\u2019s developers also may be violating the terms of their funding, according to documents about the project obtained via European Union transparency regulations. The initiative is mostly financed by an \u20ac8 million EU research and innovation grant designed for projects that are exclusively nonmilitary, but Roborder\u2019s developers acknowledge that parts of their proposed system involve military technology or could easily be converted for military use.<\/p>\n

Much of the development of Roborder is classified, but The Intercept obtained internal reports related to ethical considerations and concerns about the program. That documentation was improperly redacted and inadvertently released in full.<\/p>\n

In one of the reports, Roborder\u2019s developers sought to address ethical criteria that are tied to their EU funding. Developers considered whether their work could be modified or enhanced to harm humans and what could happen if the technology or knowledge developed in the project \u201cended up in the wrong hands.\u201d These ethical issues are raised, wrote the developers, when \u201cresearch makes use of classified information, materials or techniques; dangerous or restricted materials[;] and if specific results of the research could present a danger to participants or to society as a whole.\u201d<\/p>\n

Roborder\u2019s developers argued that these ethical concerns did not apply to their work, stating that their only goal was to develop and test the new technology, and that it would not be sold or transferred outside of the European Union during the life cycle of the project. But in interviews with The Intercept, project developers acknowledged that their technology could be repurposed and sold, even outside of Europe, after the European project cycle has finished, which is expected to happen next year.<\/p>\n

Beyond the Roborder project, the ethics reports filed with the European Commission suggest a larger question: When it comes to new technology with the potential to be used against vulnerable people in places with few human rights protections, who decides what we should and should not develop?<\/p>\n

Roborder won its<\/u> funding grant in 2017 and has set out to develop a marketable prototype \u2014 \u201ca swarm of robotics to support border monitoring\u201d \u2014 by mid-2020. Its developers hope to build and equip a collection of air, sea, and land drones that can be combined and sent out on border patrol missions, scanning for \u201cthreats\u201d autonomously based on information provided by human operators, said Stefanos Vrochidis, Roborder\u2019s project manager.<\/p>\n

The drones will employ optical, infrared, and thermal cameras; radar; and radio frequency sensors to determine threats along the border. Cell phone frequencies will be used to triangulate the location of people suspected of criminal activity, and cameras will identify humans, guns, vehicles, and other objects. \u201cThe main objective is to have as many sensors in the field as possible to assist patrol personnel,\u201d said Kostas Ioannidis, Roborder\u2019s technical manager.<\/p>\n

The end product will be tested by border police in several European countries, including Portugal, Hungary, and Greece, but the project has also generated considerable interest in the private sector. \u201cEventually, we have companies that would certainly like to exploit this commercially,\u201d Vrochidis told The Intercept. \u201cThey might exploit the whole outcome or part of the outcome, depending. They can exploit this in Europe but also outside of Europe.\u201d<\/p>\n

In their grant agreement, Roborder\u2019s developers told the European Commission that they did not foresee any exports of their technology outside of the EU. In interviews, however, developers told The Intercept that the companies involved would be open to selling their technology beyond Europe. According to a spokesperson from the grant program funding Roborder, Horizon 2020<\/a>, there is nothing Roborder\u2019s EU backers can do to control where or how the technology they bankrolled is eventually used.<\/p>\n

The documents obtained by The Intercept show Roborder responding to some ethical concerns about the project but not about the technology itself. In their grant application, Roborder\u2019s developers conceded that their research \u201cmay be exploited by criminal organizations and individual criminals when planning to perpetrate acts of serious crime or terrorism\u201d but wrote that the consortium of public and private companies developing the technology would work to keep their data safe. That group includes drone manufacturing companies, several national police departments, two national guards, a defense ministry, a port authority, a cyberdefense company, a company that specializes in developing equipment for electronic warfare, and another that provides \u201cpredictive analytics\u201d for European police forces.<\/p>\n

As for the technology\u2019s possible modification for future clients, the answers were less clear. The developers would not comment on the potential for military sales after the project cycle ends. Developers added that their work is delayed because one of Roborder\u2019s key consortium partners, Portuguese drone manufacturer Tekever, has left the project. Spokespeople for Roborder, Tekever, and Horizon 2020 would not explain the rationale for Tekever\u2019s departure.<\/p>\n

Horizon 2020 supports many security-oriented projects but maintains that<\/a> \u201conly research that has an exclusive focus on civil applications is eligible for funding.\u201d The grant program previously funded a project that uses artificial intelligence to detect <\/a>whether <\/a>travelers are lying as they pass through automated border crossings.<\/p>\n

Yet the documents obtained by The Intercept highlight inconsistent statements about Roborder\u2019s potential military uses. According to one report, the project has no potential for \u201cdual use,\u201d or both military and civil deployment. Ten pages later, asked whether their work involved items that could be considered dual-use by European standards, Roborder\u2019s developers wrote that it did.<\/p>\n

Roborder hired a consultant, Reinhard Hutter, as an external ethics adviser to the project, according to another document from the Horizon 2020 program that was inadvertently released in full by the European Commission. In his report, Hutter wrote that \u201cRoborder involves technology with military potential,\u201d and that \u201cthe results of this project have the potential to be used back in the defense sector.\u201d The technology involved, Hutter wrote, had \u201csome dual-use potential but no dual-use activity on the project.\u201d In other words, it could be used for military purposes but wouldn\u2019t be used that way within the scope of Roborder.<\/p>\n

Hutter declined to speak to The Intercept.<\/p>\n

This blurring of lines between military and civilian development by the EU funding program might be deliberate. In a\u00a02014 guidebook<\/a>\u00a0on European funding for dual-use projects, the European Commission notes that the regulation establishing Horizon 2020 mandates that all funded projects have \u201can exclusive focus\u201d on civilian development, but the document also\u00a0says\u00a0that \u201csubstantial parts of the research funded is of relevance for defense and can lead to technologies that will be used by defense actors.\u201d<\/p>\n

The authors of a\u00a02016 study<\/a>\u00a0commissioned by the\u00a0security and\u00a0defense\u00a0sub-committee\u00a0of the European Parliament went further, arguing\u00a0that\u00a0Horizon\u00a02020\u2019s clause on exclusive civilian development\u00a0should be reinterpreted to include defense research.\u00a0In order to compete with U.S. technological development,\u00a0the study\u2019s authors advocated for the creation of a European equivalent of DARPA, the\u00a0U.S.\u00a0Defense Advanced Research Projects Agency, whose work contributed to the development of the internet, GPS, and other technologies. In a 2017 speech, French President Emmanuel Macron\u00a0echoed<\/a> that, calling for, \u201ca European agency for disruptive innovation in the same vein as\u201d DARPA.<\/p>\n

The 2016 report does not represent the views of the European Parliament or its security and defense sub-committee, and was not used to develop any specific legislation, a spokesperson for the European Parliament said. A spokesperson for Horizon 2020 rejected the idea that there was any ambiguity in what kind of projects the European Union would fund.<\/p>\n

\u201cThe European Commission does not fund research intended for military use,\u201d she said.<\/p>\n

The drones Roborder<\/u> plans to deploy are common technology. What would be groundbreaking for the companies involved is a functional system that allows swarms of drones to operate autonomously and in unison to reliably identify targets. AI threat detection is often inaccurate, according to robotics researchers, so any system that could correctly and consistently identify people, cars, and weapons, among other things, would be a substantial and lucrative advancement.<\/p>\n

Drone cameras will not use facial recognition technology within the scope of the project, explained Ioannidis, Roborder\u2019s technical manager, nor will they be able to determine any human characteristics, such as height, weight, age, skin color, or perceived gender. \u201cThe system will only identify that \u2018this object is human,\u2019\u201d he added, \u201cnothing more.\u201d<\/p>\n

Still, Ioannidis admitted that adding facial recognition to the Roborder system later on would be \u201ctechnologically possible.\u201d What about weaponizing the Roborder system to act against humans? \u201cNo,\u201d he said, firmly. \u201cThe robots don\u2019t have any authority to take any action against anyone. It\u2019s just monitoring and giving alerts.\u201d<\/p>\n

But Sharkey, the U.K. robotics professor, argues that there is a thin line between using robots to monitor a border and using them to enforce one. Weaponizing a drone is relatively easy, he said, citing the 2015 case of the Connecticut teenager who equipped a drone <\/a>with a handgun<\/a> and a flamethrower<\/a>. Sharkey worries about the implications of developing autonomous systems to patrol borders, including how the system could be used by a country coping with a large influx of people.<\/p>\n

\u201cThe question is, where is this going?\u201d Sharkey asked. \u201cThe current project does not propose to weaponize them, but it would just be too tempting for countries if a tipping point were to happen with mass migration.\u201d<\/p>\n

Hannah Couchman, a researcher at the U.K. human rights organization Liberty, agrees. \u201cThere are deep human rights and civil liberty concerns with this technology,\u201d she told The Intercept. \u201cOnce this tech is developed, it\u2019s seen as a solution, as a response to austerity, and a way to do a job efficiently with a lower cost, all rolled out without proper consultation and legislative scrutiny.\u201d<\/p>\n

\u201cIt\u2019s not just about mitigating the human rights risk,\u201d Couchman said. \u201cIt\u2019s about whether we should use the technology in the first place.\u201d<\/p>\n

_____________________________________________________<\/p>\n

Related:<\/em><\/p>\n