Twitter Puts Trillions of Tweets up for Sale to Data Miners

WHISTLEBLOWING - SURVEILLANCE, 23 Mar 2015

Juliette Garside – The Guardian

Company plans to make content generated by users available to commerce, academia and even police involved in crowd control.

Twitter is quick to point out that ‘what you say on Twitter may be viewed all around the world instantly’. Photograph: Dominic Lipinski/PA

Twitter is quick to point out that ‘what you say on Twitter may be viewed all around the world instantly’. Photograph: Dominic Lipinski/PA

18 Mar 2015 – You are travelling by plane to see your newborn grandchild. As you board the aircraft, the cabin crew address you by name and congratulate you on the arrival of a bouncing baby boy. On your seat, you find a gift-wrapped blue rattle with a note from the airline.

In Twitter data strategy chief Chris Moody’s vision of the future, companies surprising their customers like this could become an everyday occurrence – made possible because Twitter is listening.

Computer systems are already aggregating trillions of tweets from the microblogging site, sorting and sifting through countless conversations, following the banter and blustering, ideas and opinions of its 288 million users in search of commercial opportunities.

It is not only commercial interests that are mining the data. Academics are using it to gauge the mood in a football crowd, and trying to shed light on whether Premier League players such as Manchester United’s Radamel Falcao are overpaid – with a team of researchers from Reading, Dundee and Cambridge universities testing whether top-flight footballers’ salaries are related purely to performance on the pitch or can be boosted by popularity on social media.

Selling data is as yet a small part of Twitter’s overall income – $70m out of a total of $1.3bn last year, with the lion’s share of cash coming from advertising, but the social network has big plans to increase that. Its acquisition of Chris Moody’s analytics company Gnip for $130m last April is a sign of that intent.

Google and Facebook have built their businesses around sharing data, but their control of our private and public information has become a source of huge controversy.

Moody acknowledges it is an area fraught with ethical and reputational risk: “One of the questions we get asked is: how do we ensure that we are not being creepy?” Context, he believes, is the key.

“Twitter gives this fascinating ability to understand people in context like we’ve never been able to do before. It’s not ‘I know that Chris Moody is a 48-year-old male’ – which is how we’ve thought about marketing in the past – but ‘I understand that Chris Moody is dealing with the death of a parent because he’s talking about it on this public platform’,” he said, adding that a Twitter user has in effect said: “I’ve stepped up to the microphone and I’ve said I want the world to know that this thing is happening in my life.”

Moody is the man with his hands on what is called Twitter’s “firehose”, the relentless datastream of half-a-billion posts produced each day. His mission is to market this torrent to companies such as IBM, Oracle and Salesforce.com, and marketing specialists like Klout, who will repackage and sell the data on to other companies to help them market to and manage their customers.

But do all Twitter users imagine they are addressing the world, or the corporations that want to listen in to their conversations?

For many, their audience is their followers – the online community that shares their interests and opinions. Twitter account holders cannot choose who follows them, but they can shape their following by blocking or muting nuisance or abusive users.

Using a hashtag, or addressing another user directly through via Twitter handle can be seen as, respectively, signals that the writer of a tweet intended it for a wider audience, or wanted direct contact with an individual or organisation. Should Twitter take these subtleties into account when distributing its data?

One possible use for Twitter data could be using geolocation and language algorithms to gauge the mood of a crowd at a football match. Photograph: Andrew Matthews/PA

One possible use for Twitter data could be using geolocation and language algorithms to gauge the mood of a crowd at a football match. Photograph: Andrew Matthews/PA

Moody thinks not. “Most people realise they can’t control their followers. Ours is the conversation of an individual to the world. We are very fortunate in that way: many social platforms don’t have that.”

Twitter can match its users to a company’s database of customers to provide targeted advertising. Profiles are matched, for example, by using emails. An insurance company that knows your home cover is about to expire might then use Twitter to send a direct advertisement, for example. It also resells data for other social networks, including photo-sharing site Tumblr and local directory Foursquare.

“You bring your data to us and we will ensure that your customers, if they exist on Twitter – we can provide advertisements to them. It’s done in a completely anonymised fashion, so we are not sharing private information.”

When Apple unveils the next iPhone later this year, Moody suggests Samsung could listen in to Twitter to help it single out customers who are thinking of ditching Apple and switching brands. It could also identify the phone features that most attract them, and use that information to design and target real-time advertising.

Research that could benefit the public sector has been made easier by a data grants programme, launched last February, that gives academics free access to the data “firehose”. As well as the UK study on footballers, other examples include Harvard University using it to track down the sources of food poisoning. The University of Wollongong is using it to track flooding in Indonesia and tweet information about the best routes out of affected areas.

Moody’s says geolocation and programs that scan for aggressive or negative reactions could be used to monitor football crowds. In this way, tweets could help gauge the reaction of fans during and after a match, helping police decide where to deploy resources in combating domestic violence or public disturbance. He is careful to stress that the information is about the crowd – not a means for police to target individual fans.

Twitter does not share the content of direct messages (DMs), which are hidden from everyone except the sender and recipient. But readers of Twitter’s privacy policy should be left in no doubt that the company considers all their other musings entirely public property. It warns: “What you say on Twitter may be viewed all around the world instantly.”

Go to Original – theguardian.com

Share this article:


DISCLAIMER: The statements, views and opinions expressed in pieces republished here are solely those of the authors and do not necessarily represent those of TMS. In accordance with title 17 U.S.C. section 107, this material is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. TMS has no affiliation whatsoever with the originator of this article nor is TMS endorsed or sponsored by the originator. “GO TO ORIGINAL” links are provided as a convenience to our readers and allow for verification of authenticity. However, as originating pages are often updated by their originating host sites, the versions posted may not match the versions our readers view when clicking the “GO TO ORIGINAL” links. This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of environmental, political, human rights, economic, democracy, scientific, and social justice issues, etc. We believe this constitutes a ‘fair use’ of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more information go to: http://www.law.cornell.edu/uscode/17/107.shtml. If you wish to use copyrighted material from this site for purposes of your own that go beyond ‘fair use’, you must obtain permission from the copyright owner.

One Response to “Twitter Puts Trillions of Tweets up for Sale to Data Miners”

  1. rosemerry says:

    I remember reading about a man finding out his daughter was pregnant because Target was keeping tabs on what she bought!
    I am delighted to avoid facebook and twitter, as there is enough snooping in everyday life already.