"We exploited Facebook to harvest millions of profiles. And built models to exploit that and target their inner demons". Cambridge Analytica Whistleblower, Christopher Wylie.
It's been a longstanding major area of concern, of course, that neurotechnologies and 'behavioural change' techniques may be used to redirect decision makers without their explicit permission. After all, neuromarketing - the idea that the brain can reveal hidden and profitable truths - is founded on the development of strategies of persuasion in order to profit. This doesn't just raise ethical concerns in the market place, since neuromarketing strategies are being used in wider contexts, such as shaping political narratives and communications, election campaigning, policy making and within the media. The motive for employing these techniques is nonetheless about gaining a profit, if not financially, then certainly in terms of advantage and power.
I have criticised behavioural economics extensively on previous occasions. Since 2010, it has somehow become acceptable for governments to exercise an influence on the decision-making and behaviours of citizens. Libertarian paternalism, under the guise of 'behavioural science', has normalised a manipulative, authoritarian approach for state micro-management of the perceptions, decisions and behaviours of populations. However, being a political doctrine itself, libertarian paternalism is not value-neutral or 'objective'.
Behavioural economics is a flagrant political misuse of psychology, a form of manipulation without the publics' knowledge and consent. This of course has profound implications for democracy, as the state is 'acting upon' citizens in ways that they won't recognise to change their behaviours and to manipulate their decision-making. In fact it turns democracy completely on its head.
It's accepted uncritically that people can pay companies and organisations to change people's minds and persuade them to change their decisions and behaviours, be it simply aimed politically at individuals' perceived 'faulty' decision-making, allegedly involved in their circumstances of povery, claiming welfare support, or voting for a party that hasn't paid a PR company to manipulate your voting decision.
Harvard Law Professor Cass Sunstein, (co-author of “Nudge” and one of the founders of behavioural economics), wrote a controversial paper in 2008 proposing that the US government employ teams of covert agents and pseudo-independent advocates to “cognitively infiltrate” online groups and websites, as well as other activist groups.
Sunstein also proposed sending covert agents into “chat rooms, online social networks, or even real-space groups” which spread what he views as false and damaging “conspiracy theories” about the government. Ironically, the very same Sunstein was named by Obama to serve as a member of the NSA review panel created by the White House, one that – while disputing key NSA claims – proceeded to propose many cosmetic reforms to the agency’s powers (most of which were ignored by the President who appointed them).
Back in 2014, GCHQ documents released from the Edward Snowden archive by Glenn Greenwald, were the first to prove that a major western government is using some of the most controversial techniques to disseminate deception online and harm the reputations of targets. Under the tactics they use, the state is deliberately spreading lies and misinformation on the internet about whichever individuals it targets, including the use of what GCHQ itself calls “false flag operations” and emails to people’s families and friends. The Snowden archive outlines how western intelligence agencies are attempting to manipulate and control online discourse with extreme tactics of deception and reputation-destruction.
Who would possibly trust a government to exercise these powers at all, let alone do so in secret, with virtually no oversight, and outside of any cognizable legal framework?
Then there is, as I've discussed, the political misuse of psychology and other social sciences to not only understand, but shape and control, how online activism and discourse unfolds. Glenn Greenwald's published document on the Intercept touts the work of GCHQ’s “Human Science Operations Cell,” devoted to “online human intelligence” and “strategic influence and disruption.” Under the title “Online Covert Action”, the document details a variety of means to engage in “influence and info ops” as well as “disruption and computer net attack,” while dissecting how human beings can be manipulated using “leaders,” “trust,” “obedience” and “compliance”.
It's not such a big inferential leap to conclude that governments are attempting to manage legitimate criticism and opposition while stage managing our democracy.
I don't differentiate a great deal between the behavioural insights team at the heart of the Conservative cabinet ofice, and the dark world of PR and companies like Cambridge Analytica. The political misuse of psychology has been disguised as some kind of technocratic “fix” for a failing neoliberal paradigm, and paraded as neutral “science”.
However, its role as an authoritarian prop for an ideological imposition on the population has always been apparent to some of us, because the bottom line is that it is all about influencing people's perceptions and decisions, using psychological warfare strategies. The Conservatives’ behaviour change agenda is designed to align citizen’s perceptions and behaviours with neoliberal ideology and the interests of the state. However, in democratic societies, governments are traditionally elected to reflect and meet public needs. The use of “behaviour change” policy involves the state acting upon individuals, and instructing them how they must be.
Last year, I wrote a detailed article about some of these issues, including discussion of Cambridge Analytica's involvement in data mining and the political “dark” advertising that is only seen by its intended recipients. This is a much greater cause for concern than “fake news” in the spread of misinformation, because it is invisible to everyone but the person being targeted. This means that the individually tailored messages are not open to public scrutiny, nor are they fact checked.
A further problem is that no-one is monitoring the impact of the tailored messages and the potential to cause harm to individuals. The dark adverts are designed to exploit people’s psychological vulnerabilities, using personality profiling, which is controversial in itself. Intentionally generating and manipulating fear and anxiety to influence political outcomes isn’t a new thing. Despots have been using fear and slightly less subtle types of citizen “behaviour change” programmes for a long time.
About Cambridge Analytica: political psyops verified by a whistleblower
Controversy has arisen concerning Cambridge Analytica's use of personal information acquired by an external researcher, who claimed to be collecting it for "academic purposes". The use of personal data collected without knowledge or permission to establish sophisticated models of user's personalities raises ethical and privacy issues.
In a somewhat late response, Facebook banned Cambridge Analytica from advertising on its platform. The Guardian has further reported that Facebook had known about this security breach for two years, but did nothing to protect its millions of users.
It is well known that Cambridge Analytica (CA) collects data on voters using sources such as demographics, consumer activity and internet activity, among other public and private sources. It has been reported that the company is using psychological data derived from millions of Facebook users, largely without users' permission or knowledge. In short, the company operates using political voter surveillance and strategies of psychological manipulation.
The data analytics firm is a private company that offers services to businesses and political parties who want to “change audience behaviour”. CA combines data mining and data analysis with 'strategic communication' for the electoral process. It was created in 2013 as an offshoot of its British parent company SCL Group to participate in US politics. The company claims to use "data enhancement and audience segmentation techniques" providing 'psychographic analysis' for a "deeper knowledge of the target audience". The company is known to use the 'big five' OCEAN scale of personality traits.
The company also claims to use 'behavioural microtargeting' and indicates that it can predict 'needs' of subjects and how these needs may change over time. Services then can be individually targeted for the benefit of its clients from the political arena, governments, and companies providing "a better and more actionable view of their key audiences."
CA, who worked with Donald Trump’s election team and the Brexit campaign, has harvested millions of Facebook profiles of US voters, in one of the technological giant’s biggest ever data breaches, and used them to build a powerful software program to psychologically profile, predict and influence citizens' voting choices. The managing director of CA's controversial political division is Mark Turnbull, who spent 18 years at the communications firm Bell Pottinger before joining Strategic Communication Laboratories (SCL), which is a British 'behavioural science' company.
The SCL Group, that once advised Nato on so-called “psy-ops”, is a private British behavioural research and strategic communication company. The company describes itself as “global election management agency”. SCL’s approach to propaganda is based upon a methodology developed by the associated Behavioural Dynamics Institute (BDI).
Nigel Oakes founded the latter and also set up Strategic Communication Laboratories and using the new methodology from BDI, ran election campaigns and national communications campaigns for a broad variety of international governments.
BDI say: “The goal of the BDI is to establish Behavioural Dynamics as a discipline for the study of group behaviour change.”
There isn’t much information around about BDI's connection with military operations, though links with NATO are well-established – see Countering propaganda: NATO spearheads use of behavioural change science, for example. From the article: “Target Audience Analysis, a scientific application developed by the UK based Behavioural Dynamics Institute, that involves a comprehensive study of audience groups and forms the basis for interventions aimed at reinforcing or changing attitudes and behaviour.”
SCL on the other hand, has a clearly defined defence and military division who: “Target Audience Analysis, a scientific application developed by the UK based Behavioural Dynamics Institute, that involves a comprehensive study of audience groups and forms the basis for interventions aimed at reinforcing or changing attitudes and behaviour.”
SCL has different “verticals” in politics, military and commercial operations. All of those operations are based on the same methodology (Target Audience Analysis) and, as far as can be discerned from the outside, SCL and affiliates have very obscure corporate structures with confusing ownership.
In the United States, SCL has gained public recognition mainly though its affiliated corporation Cambridge Analytica (CA). It was created in 2013 as an offshoot of its British parent company (the SCL Group,) to participate in US politics. In 2014, CA was involved in 44 US political races. Their site says: “Cambridge Analytica uses data to change audience behavior.”
The recent controversy
Working with a whistleblower who helped set up Cambridge Analytica, the Observer and Guardian have seen documents and gathered eyewitness reports that lift the lid on the data analytics firm that helped Donald Trump to victory. The company is currently being investigated on both sides of the Atlantic.
It is a key subject in two inquiries in the UK - by the Electoral Commission, into the company's possible role in the EU referendum and the Information Commissioner's Office, into data analytics for political purposes - and one in the US, as part of special counsel Robert Mueller's probe into Trump-Russia collusion.
Previous articles by Carole Cadwalladr in the Observer and Guardian newspapers, respectively published in February and May 2017, speculated in detail that CA had influenced both the Brexit/Vote Leave option in the UK's 2016 EU membership referendum and Trump's 2016 US presidential campaign with Robert Mercer's backing of Donald Trump being key. They also discuss the legality of using the social data farmed. CA says it is pursuing legal action over the claims made in Cadwalladr's articles.
The whistleblower, Chris Wylie, claims that the 50 million mostly American, profiles were harvested in one of Facebook’s biggest data breaches has caused outrage on both sides of the Atlantic, with lawmakers in both the UK and America, and a state attorney general calling for greater accountabilityand regulation. The profiles were harvested by a UK-based academic, Aleksandre Kogan, and his company, Global Science Research (GSR).
Wylie said the personal information mined was used to build a system to influence voters. The Canadian, who previously worked for Cambridge Analytica, has lifted the lid on this and other practices at the company, which he describes as a “full-service propaganda machine”.
Shortly before the story broke, Facebook’s external lawyers warned the Observer that it was making “false and defamatory” allegations and reserved Facebook’s legal position. Facebook denies the harvesting of tens of millions of profiles by CA, working with Cambridge academic Aleksandr Kogan and his firm GSR, was a data breach.
Facebook have also suspended the whistleblower Chris Wylie from the platform “pending further information” over misuse of data, along with his former employer, CA and its affiliates, and the academic they worked with, Aleksandr Kogan.
The public attack on Wylie came after he had approached Facebook about the data breach, offering to help investigate. He described it as a chilling attack on someone acting in the public interest.
“They acknowledged my offer but then turned around and shot the messenger. I’m trying to make amends for my mistakes and so should Facebook,” he told the Guardian.
“Facebook has known about this for at least two years and did almost nothing to fix it. This is not new. And it’s only by coming forward that Facebook is now taking action. People need to know this kind of profiling is happening.”
Kogan assembled the harvested information through an app on the site – it collected details of Americans who were paid to take a personality test, but also gathered data on those people’s Facebook friends.
Kogan apparently had a deal to share this information with CA But according to Wylie, most of this personal information had been taken without authorisation. He said Cambridge Analytica used it to build a powerful software program to predict and influence choices at the ballot box.
Last month, both Facebook and CA CEO Alexander Nix told the parliamentary inquiry into fake news that the company did not have or use private Facebook data, or any data from Kogan’s firm, GSR.
But in its statement on Friday night, explaining why it had suspended Cambridge Analytica and Wylie, Facebook said it had known in 2015 that profiles were passed to Nix’s company.
CA is heavily funded by the family of Robert Mercer, an American hedge-fund billionaire. I’ve mentioned Mercer in a previous article about the right’s undue influence on the media and on voting behaviour. Mercer made his money as a pioneer in the field of Computational Linguistics.
The company was headed by Trump’s key adviser Steve Bannon. CA used personal information taken without authorisation in early 2014 to build a system that could profile individual US voters, in order to target them with 'personalised' persuasive political 'advertisements'.
It's scandalous that documents seen by the Observer, and confirmed by the Facebook statement, show that by late 2015 the Facebook had found out that information had been harvested on an unprecedented scale and failed to alert users, taking only limited steps to recover and secure the private information of more than 50 million individuals.
Last year, Dr Simon Moores, visiting lecturer in the applied sciences and computing department at Canterbury Christ Church University and a technology ambassador under the Blair government, said the Information Commisioners Office’s recent decision to shine a light on the use of big data in politics was timely. He said:
“A rapid convergence in the data mining, algorithmic and granular analytics capabilities of companies like Cambridge Analytica and Facebook is creating powerful, unregulated and opaque ‘intelligence platforms’. In turn, these can have enormous influence to affect what we learn, how we feel, and how we vote. The algorithms they may produce are frequently hidden from scrutiny and we see only the results of any insights they might choose to publish.”
He goes on to say: ”They were using 40-50,000 different variants of an ad every day that were continuously measuring responses and then adapting and evolving based on that response.”
The head of the parliamentary committee investigating fake news has accused CA and Facebook of misleading MPs in testimony.
After a Wylie detailed the harvesting of more than 50 million Facebook profiles for CA, Damian Collins, the chair of the House of Commons culture, media and sport select committee, said he would be calling on the Facebook boss, Mark Zuckerberg, to testify before the committee.
He said the company appeared to have previously sent executives able to avoid difficult questions who had “claimed not to know the answers”.
Collins also said he would be recalling the CA's CEO, Alexander Nix, to give further testimony. “Nix denied to the committee last month that his company had received any data from [his firm] GSR,” he said. “We will be contacting Alexander Nix next week asking him to explain his comments.”
Collins has attacked Facebook for appearing to have been “deliberately avoiding answering straight questions” in testimony to the committee.
“It is now clear that data has been taken from Facebook users without their consent, and was then processed by a third party and used to support their campaigns,” Collins said. “Facebook knew about this, and the involvement of Cambridge Analytica with it.”
CA said that its contract with GSR stipulated that Kogan should seek 'informed consent' for data collection and it had no reason to believe he would not.
GSR was “led by a seemingly reputable academic at an internationally renowned institution who made explicit contractual commitments to us regarding its legal authority to license data to SCL Elections”, a company spokesman said.
The Observer has seen a contract dated 4 June 2014, which confirms SCL, an affiliate of CA, entered into a commercial arrangement with GSR, entirely premised on harvesting and processing Facebook data. CA spent nearly $1m on data collection, which yielded more than 50 million individual profiles that could be matched to electoral rolls. It then used the test results and Facebook data to build an algorithm that could analyse individual Facebook profiles and determine personality traits linked to voting behaviour.
The algorithm and database together made a powerful political tool for the right. It allowed a campaign to identify possible swing voters and craft messages more likely to 'resonate'.
“The ultimate product of the training set is creating a ‘gold standard’ of understanding personality from Facebook profile information,” the contract specifies. It promises to create a database of 2 million “matched” profiles, identifiable and tied to electoral registers, across 11 states, but with room to expand much further.
CA responded to the Observer story on Twitter before Collins had said Nix would be recalled. “We refute(s) these mischaracterizations and false allegations,” it said:
“Reality Check: Cambridge Analytica uses client and commercially and publicly available data; we don’t use or hold any Facebook data,” the company said. “When we learned GSR sold us Facebook data that it shouldn’t have done, we deleted it all – system wide audit to verify.”
In response I quoted several claims from CA's own site, which I had cited in an article last year.
For example, the company offers to: More effectively engage and persuade voters using specially tailored language and visual ad combinations crafted with insights gleaned from behavioral understandings of your electorate.”
And boasts:“Leveraging CA’s massive team of data scientists and academics, CA is able to provide optimal audience segments based on big data and psychographic modeling. Then, using a sophisticated electronic data delivery system, CA is able to provide TV advertising campaign data that may be used to inform media buyers about shows that have the highest concentrations of target audiences and the least amount of waste; all of which leading to higher media ROI [return on investment] and more voter conversions.”
"CA Political will equip you with the data and insights necessary to drive your voters to the polls and win your campaign. We offer a proven combination of predictive analytics, behavioral sciences, and data-driven ad tech."
"With up to 5,000 data points on over 230 million American voters, we build your custom target audience, then use this crucial information to engage, persuade, and motivate them to act."
And offers to help to: "More effectively engage and persuade voters using specially tailored language and visual ad combinations crafted with insights gleaned from behavioral understandings of your electorate."
It seems that the overarching logic of neoliberalism has led to the privatisation of citizens' decision making and behaviour; democracy has been commodified and marketised.
|by Kitty S Jones|