Who's Responsible?

Who's Responsible?
"We  live  in  a  society  in  which  spurious  realities  are manufactured  by  the  media,  by governments ,  by  big  corporations,  by  religious  groups,  political  groups.  I  ask,  in  my  writing, 'What is real?' Because increasingly we are bombarded with pseudo realities manufactured by very sophisticated people using very sophisticated electronic mechanisms."   Philip K Dick

Page Contents

1   Overview [Who's Generating The Stuff?]
Misinformation is today being generated and propagated on an industrial scale. So, whilst the Internet has morphed into a fantastic tool for communication and intellectual, social and economic development, it has also become a conduit for rumour and bile. It has been described as "an electronic asylum filled with babbling loonies" (Mike Royko), "the biggest lavatory wall in history" (AC Grayling), and the place where "no gatekeepers insist you pay the price of accuracy before publishing and lies are given the same status as truth."  (Nick Cohen)
At one end of the 'lavatory wall' we have immature, ill-informed or disturbed individuals locked away in their bedrooms with their smart phone, tablet or laptop. Then there are the sick, sad, malevolent or misled individuals who create or spread 'fake news' and conspiracy theories; and the wise-boys and fraudsters who use various techniques (including click-bait) to attract or ensnare punters
Next there are the media moguls and government bodies that carefully select their ‘facts’ or spin stories, and twist or distort the truth in the process. They are followed closely by the powerful lobbyists and pressure groups with their own special interests (anti-vaxxers, climate change deniers, alternative therapists and the like) — and religious bodies and cults that seek to present belief as ‘fact’.[1] These special interest groups collectively reject science and have little or no respect for reasoned argument.   
And taking their place at the other end of the 'lavatory wall' there are hostile foreign powers spreading fake news and disinformation, who seek to confuse and polarise public opinion and undermine public confidence in democracy / open society.

These different actors are portrayed and characterised in the matrix below:
Efforts to address these groups and the consequences of their labours are explored on another Page.
2   Sad Individuals & Machine Bias
As already noted, people spread false or misleading information for any number of reasons. This includes a significant minority who pass on or actively promote untruths with the express intention of endorsing what they consider to be a deeper ‘emotional truth’, regardless of the ‘facts’ and often in contradiction to scientific consensus. 

Whether emotional truths are 'lies' depends on the context and the intention. Most people would say that lying is always wrong — except when there's a good reason for it! [See  Lies & Lying.]
So much for people, what about machines? Smart software is being used increasingly to detect hate speech, violent videos and illegal material online, but can it exhibit bias? Whether we realise it or not, machine learnings/artificial intelligence is playing an increasingly important role in our lives. Indeed, ‘black box’ algorithms are substituting for human decision-making in many different contexts.
We see this with Google searching, Amazon pricing, ‘automated sentiment analysis’ (that’s providing financial information), and with the hidden recommendation systems deployed on social media. It is also being used in facial recognition and in the selection of videos, adverts and a variety of products and online services, and the way it does this can favour some clients or interests over others. 
Following the 2016 US Presidential Election it has been claimed that YouTube’s AI was partisan towards the candidates: on the eve of the Election, one group of researchers gathered recommendation data on the two main candidates and found that more than 80% of recommended videos were favorable to Trump, whether the initial query was 'Trump' or 'Clinton'. Moreover, "a large proportion of these recommendations were fake news.”[2] Whether this influenced voting patterns is yet to be established.
  • Filter Bubbles & Confirmation Bias

    “If one were to attempt to identify a single problematic aspect of human reasoning that deserves attention above all others, then confirmation bias would have to be among the candidates for consideration. Many have written about this bias, and it appears to be sufficiently strong and pervasive that one is led to wonder whether the bias, by itself, might account for a significant fraction of the disputes, altercations, and misunderstandings that occur among individuals, groups, and nations."   Raymond S Nickerson


    Most of us lack the education or training to cope effectively with lies and deception; and our judgement may also be compromised by inbuilt insecurity, prejudice, innate conservatism and resistance to change. We live in our own ‘filter bubble’ where we choose the 'facts' and opinions we are most comfortable with, and share these with our close friends in our own personal 'echo chamber'. 


    In today's 'post-truth' world many of us have lost faith in politicians and the mainstream media, and increasingly rely for information on social media; and much of what we absorb may have little or no basis in fact. This however does not seem to deter us, in fact it can actually reinforce our beliefs and prejudices.


    Moreover, when we go on line, our search engine helpfully selects things that it 'thinks' we will want to see, once again confirming our views. The social media we are addicted to also 'knows' what interests or excites us and its algorithms deliberately 'nudge' us towards more and more extreme material. The result of this pre-selection is that we are effectively isolated from uncomfortable facts or alternative points of view.


    As Richard Gingras (Google News) points out, "affirmation is more satisfying than information — always has been."  

3   Malcontents & Criminals
Cybercrime covers a wide range of activities that involve computing, including hacking, identity theft and child pornography. 
Numerically, most cybercrime affects ordinary individuals or their personal accounts. It can involve: phishing; file hijacking; criminals taking over one's computer (to take screenshots, steal information, get passwords or manipulate the webcam); also keylogging and ad clicking (opening an email or webpage to expose the victim to malware or for information theft).

The main types of cybercrime for businesses include hacking to gain access to sensitive data (trade secrets, staff and client data, etc.), denial of service attacks (perhaps involving multiple compromised computers infected with a Trojan or some other malware),  and ransomware
Cybercrime is discussed on a separate page — along with the adjacent graphic (from InformationIsBeautiful); and the definition of specialist terms can be found in the Glossary.
Fake 'Likes' & Hijacked Accounts
Some people make a lot of money from selling fake followers. In Jan 2018 New York's Chief Prosecutor announced that the state was opening an investigation into one operation, Devumi, that is alleged to have sold millions of fake followers to social media users. The Prosecutor said he was concerned that such ‘opaque’ operations were undermining democracy.
The action follows publication, by the New York Times, of an explosive report, ‘The Follower Factory’, which accuses Devumi of stealing people's identities (a claim it denies). The report also contains details of interviews with people who allege that their account details and profile pictures had been copied to create bots. It appears that actors, entrepreneurs and political commentators who wanted to increase their follower count were paying to be followed by these (often highly realistic) bots. On social media, high follower accounts boost influence, which can impact public opinion, or bring advantages to account holders, such as job offers or sponsorship deals. [3]
  • How Fakers Cover their Tracks

    Someone’s profile and background images are stolen; their portrait is then colour-shifted and recompressed (to evade automated detection). One or more letters in the account name is changed e.g. from a lowercase 'i' to a lowercase 'l', or on '0' for an 'O' (which is easy to miss). 


    Two give-aways of fake accounts are: unusual ratios (bots typically following thousands of accounts but with very few followers themselves), and bot accounts retweeting content on a dizzying assortment of topics and in a range of different languages.

4   Conspiracy Theorists & Extremists
Too many of us are seduced by conspiracy theories — we are more comfortable believing simple lies rather than complex truths. But simplistic policies (walls, bans, censorship, etc.) are rarely a solution for complex, multi-faceted and multi-dimensional problems, and in many cases only serve to make matters worse. They also play into the hands of extremists who seek to impose their particular brand of intolerance or insanity on the rest of us.          
Today any fad, belief or lifestyle choice, however bizarre it may appears to the majority of the population, can now find a large supportive community on line — or as  Daniel Kahneman puts it, "people can maintain an unshakable faith in any proposition, however absurd, when they are sustained by a community of like-minded believers.”  This also applies to extremist groups like ISIS who have shown themselves to be very accomplished at using social media for grooming vulnerable people and promulgating their intolerant views / propaganda.            
 Sometimes the mainstream media falls into the trap of 'false equivalence', giving equal airtime / column inches to the different sides of an argument, as if the two sides were equally valid — like pitting a climate change denier against a respected climate scientist, or a Creationist against eminent intellectuals like Richard Dawkins or Bill Nye. Such reporting is irresponsible[4] and an have significant and highly undesirable ramifications, for example where it involves such topics as vaccination, genetic modification, stem-cell research or climate change.      
5   Hostile Governments & State Actors
State disinformation campaigns are often characterised by repetitive narratives appearing to emanate from a variety of sources. They develop 'legs' and become more credible if they are shared by friends, respected commentators or political leaders, or better still, taken up by the mainstream media / reputable publishing houses. Social media provides the perfect medium for disseminating state-sponsored rumour, half-truths and outright lies. It is ably assisted by hijacked or fake accounts and automated bots.
These activities are part of a broader cyberwar involving intelligence gathering and data / intellectual property theft. Today, Russia is the undisputed leader in the disinformation 'game', but China is fast catching up (along with India, Turkey,  Iran, etc.)
There appears to be some copying and cross-fertilization of ideas going on, although the actual degree of premeditated coordination is not clear.

To understand what's behind these campaigns it is important to understand the historical context, and what has been dubbed 'the rise of the civilisation-state' — see Pulldown below.
Russia
In the UK CREST (the Centre for Research & Evidence on Security Threats) has written a number of reports on the Russian agencies and nation state actors that are involved in agressive disinformation campaigning. It describes 'nation state actors' as people or groups with "a licence to kill", who "work for a government to disrupt or compromise target governments, organisations or individuals to gain access to valuable data or intelligence, and can create incidents that have international significance. They might be part of a semi-hidden ‘cyber army’ or ‘hackers for hire’ for companies that are aligned to the aims of a government or dictatorship."
 A specialist Unit set up by the European Union in 2015, EU vs Disinfo, focuses on identifying and debunking 'fake news' and disinformation. To date (July 2020) it has logged (and debunked) more than 8,000 stories that it believes have been produced or spun by the Kremlin or pro-Kremlin proxies. The Kremlin has been particularly active during the Covid-19 pandamic.[5] Nothing appears to be beneath it.
When stories are challenged, Russia’s strategy is to deny any knowledge of any wrong doing and often to accuse the accusers of Russophobia. And when things go catastrophically wrong — as happened with the downing of the MH17 airliner over Ukraine and the Skripal poisoning in Salisbury — the Kremlin puts out a raft of contradictory stories to confuse the public, both at home and abroad. However, its fingerprints were all over both incidents, and one day justice will catch up with the perpetrators of these heinous crimes. 
Russia's strategy has been characterised by the Atlantic Council’s cybersecurity guru, Ben Nimmo, as the ‘4D’ model of disinformation: dismiss critics, distort facts, distract from other issues, and dismay the audience. 
The image is of a protest in Kiev following the Feb 24 invasion by Russia / Putin.  [More to follow...]
China
China has long sought to influence the media and information space in other countries, but its efforts have intensified in recent years under Xi Jinping. Much of the activity has been overt, with diplomats publishing op-eds or state-run news outlets generating propaganda, but that has now changed with pro-Beijing actors reportedly carrying out "a whole range of covert activities in multiple countries and languages", with campaigns aiming "to spread proven falsehoods, sow societal discord and panic, manipulate perceptions of public opinion, or undermine the democratic process." And much of this work is being carried out by Beijing’s self-styled 'wolf warriors'.

 The disinformation became noticably more aggressive following the democracy demonstrations in Hong Kong in 2019[6] and the  Covid-19 outbreak, with the Chinese Communist Party striving to both exert its authority and at the same time try to repair the damage to its reputation. It even adopted some of President Trumps' language [it called him a "racist a**hole"] and  challenged narratives suggesting that the outbreak started in Wuhan whilst at the same time encouraging stories about the virus being created in the USA as a bioweapon.

China also started an effective charm offensive — when Italy ordered facemasks from companies in Germany and France and emergency laws were huredly passed blocking the shipments, China smartly stepped in and donated 200,000 facemasks and sent a team of doctors from Wuhan!
The Wholesale Manipulation of Social Media
An increasing number of countries appear to be active internally manipulating social media platforms. A University of Oxford report concluded that in 2020 organised social media manipulation campaigns were occurring in no less than 81 countries (see pulldown 'Industrial Disinformation).
  • The Rise of the Civilisation-State

    This pulldown contains extracts from ‘The irresistible rise of the civilisation-state’ by Aris Roussinos which help explain the mind-set of China and Russia. “Western liberalism,” Roussinos notes, “has no answer to assertive powers that take pride in their cultural roots.”


    “A spectre is haunting the liberal West: the rise of the “civilisation-state”. As America’s political power wanes and its moral authority collapses, the rising challengers of Eurasia have adopted the model of the civilisation-state to distinguish themselves from a paralysed liberal order, which lurches from crisis to crisis without ever quite dying nor yet birthing a viable successor. Summarising the civilisation-state model, the political theorist Adrian Pabst observes that “in China and Russia the ruling classes reject Western liberalism and the expansion of a global market society. They define their countries as distinctive civilisations with their own unique cultural values and political institutions.” From China to India, Russia to Turkey, the great and middling powers of Eurasia are drawing ideological succour from the pre-liberal empires from which they claim descent, remoulding their non-democratic, statist political systems as a source of strength rather than weakness, and upturning the liberal-democratic triumphalism of the late 20th century... 


    In his influential 2012 book The China Wave: Rise of a Civilizational State, the Chinese political theorist Zhang Weiwei observed with pride that “China is now the only country in the world which has amalgamated the world’s longest continuous civilization with a huge modern state… Being the world’s longest continuous civilization has allowed China’s traditions to evolve, develop and adapt in virtually all branches of human knowledge and practices, such as political governance, economics, education, art, music, literature, architecture, military, sports, food and medicine. The original, continuous and endogenous nature of these traditions is indeed rare and unique in the world.” Unlike the ever-changing West, constantly searching after progress and reordering its societies to suit the intellectual fashions of the moment, Weiwei observes that “China draws on its ancient traditions and wisdoms,” and its return to pre-eminence is the natural result...


    The appeal of the civilisation-state model is not limited to China. Under Putin, the other great Eurasian empire, Russia, has publicly abandoned the Europe-focused liberalising projects of the 1990s — a period of dramatic economic and societal collapse driven by adherence to the policies of Western liberal theorists — for its own cultural sonderweg or special path of a uniquely Russian civilisation centred on an all-powerful state. In a 2013 address to the Valdai Club, Putin remarked that Russia “has always evolved as a state‑civilisation, reinforced by the Russian people, Russian language, Russian culture, Russian Orthodox Church and the country’s other traditional religions. It is precisely the state‑civilisation model that has shaped our state polity.”... 


    Whereas the rising civilisation-states of Eurasia define themselves against the liberal West, the West, and Europe, struggle to define their own very natures, and place greater intellectual emphasis on deconstructing it than on defending it: an urge that is, like the impetus to deny the existence of civilisations as bounded entities, itself ironically a unique marker of our own civilisation. Perhaps a civilisation is merely an empire that survived through and past the age of nation states, yet it is nation states, carved from the bloody wreckage of past empires, that define modern Europe. Perhaps Guy Verhofstadt, the risible butt of Brexiteer mirth, was right after all when he observed that “the world order of tomorrow is not a world order based on nation states or countries. It’s a world order that is based on empires”... 


    Even within the American empire, the collapse of US power abroad and the growing disfavour with which European civilisation is held in the United States itself do not bode well for the longterm survival of a coherent Western civilisation. If the West, like liberalism, is at this stage merely a justifying ideology for the American empire, then we will be forced to replace it with something else soon enough. It is precisely this problem of determining what that replacement will be that will define Britain and Europe’s politics for the rest of our lifetimes. Europe’s ageing liberal ideologues, the fading 1968 generation which has dominated our politics for so long, do not appear to have answers for these questions; indeed, they do not even seem to realise, even now, that these questions exist...


    In the new age of the civilisation-state, perhaps the greatest challenge to our social harmony will come not from the challengers beyond our cultural borders, but from the battle within them to define who and what they defend.”


  • Industrial Disinformation

    This pulldown presents the conclusions of a report from the Oxford Internet Institute and entitled ‘Industrialized Disinformation’: 


    “The manipulation of public opinion over social media remains a critical threat to democracy. Over the past four years, we have monitored the global organization of social media manipulation by governments and political parties, and the various private companies and other organizations they work with to spread disinformation. Our 2020 report highlights the recent trends of computational propaganda across 81 countries and the evolving tools, capacities, strategies, and resources used to manipulate public opinion around the globe.” It goes on to identify three key trends in this year’s inventory of disinformation activity:


    1. Cyber troop activity continues to increase around the world. This year, we found evidence of 81 countries using social media to spread computational propaganda and disinformation about politics. This has increased from last years’ report, in which we identified 70 countries with cyber troop activity.


    2. Over the last year, social media firms have taken important steps to combat the misuse of their platforms by cyber troops. Public announcements by Facebook and Twitter between January 2019 and November 2020 reveal that more than 317,000 accounts and pages have been removed by the platforms. Nonetheless, almost US $10 million has still been spent on political advertisements by cyber troops operating around the world. 


    3. Private firms increasingly provide manipulation campaigns. In our 2020 report, we found firms operating in forty-eight countries, deploying computational propaganda on behalf of a political actor.  Since 2018 there have been more than 65 firms offering computational propaganda as a service. In total, we have found almost US $60 million was spent on hiring these firms since 2009.


    The report’s main conclusion is that “industrialized disinformation has become more professionalized, and produced on a large scale by major governments, political parties, and public relations firms.”


6   What Constitutes an Act of War?
Key questions that arise from the above discussion in the previous section are:
  •   When does interference in domestic affairs become an act of war? and
  •   What should governments do if a cyber attack knocks out, say, air traffic control at a major airport, or the national grid, but the attack cannot be traced conclusively to a foreign government or a terrorist group?
 It is well nigh impossible to identify perpetrators with 100 percent confidence if they take even rudimentary steps to cover their digital tracks...

There is currently no universally agreed position on when an aggressive act — like the Shamoon virus attack in Saudi Arabia in 2012[7] — becomes an ‘act of war’. A Digital Geneva Convention is needed urgently. [See 'Tallin Manual' in pulldown below]
Cyberspace is the 5th battlegound (after land, sea, air & space). An article in Foreign Policy notes that "the great challenge for military and cybersecurity professionals is that incoming attacks are not predictable, and current strategies for prevention tend to share the flawed assumption that the rules of conventional war extend to cyberspace as well. Cyberwarfare does have rules, but they’re not the ones we’re used to — and a sense of fair play isn’t one of them." The author notes that: "The first step to improving cyberdefense would be to determine what does, in fact, constitute a cyberattack by a foreign power as opposed to a mere prank or industrial espionage... Then officials and legislators need to decide what constitutes an act of justifiable self-defense during and after such an attack."

The article concludeds with the chilling observation that: "in the absence of a binding global accord, the world will remain vulnerable to a motley mix of hackers, warriors, intelligence operatives, criminals, and angry teenagers."
  • Tallin Manual [on the International Law Applicable to Cyber Operations]

    In 2013, a group of experts on digital law convened in Tallinn, Estonia, and wrote the Tallinn Manual, which is the closest thing to digital Geneva Conventions that the world currently has. This defines the characteristics of a cyberattack, including targeting and disabling critical infrastructure, hitting health care facilities, destroying transportation corridors or vehicles containing people, and attempts to penetrate the computer networks of opposing military forces. 


    The original version of the Manual was less clear about disinformation campaigns and hacking elections, but it did deem interference in a foreign country’s elections a violation of state sovereignty if it included an attempt at regime change. And the evidence of such activities in a growing number of countries is mounting up...


Is there anything wrong with this page? If you would like to comment on the content, style, or the choice or use of material on this page, please use the contact form. Thank you!

Notes
1    This denial of science / rejection of expert advice is particularly worrying when it concerns healthcare (see pages on Covid-19 and Pseudoscience). 
  YouTube's AI system recommends tens of billions of videos every single day, yielding billions of views. It is optimized to maximize time spent online and clicks; the combination of those is called engagement. Hence, recommendations are aligned with engagement. YouTube has been blamed inter alia for a rise in Flat Earthers!
3    On its website, Devumi offers customers the chance to order up to 250,000 Twitter followers, with prices starting at $12 (£8.50). Clients can also buy ‘likes’ and retweets. The company sells followers on a range of other platforms, including Pinterest, LinkedIn, Soundcloud and YouTube. The Devumi website claims to have “helped over 200,000 businesses, celebrities, musicians, YouTubers and other pros gain more exposure and make a big impact to their audience.” The NYT  report claims that “At least 55,000 of the accounts use the names, profile pictures, hometowns and other personal details of real Twitter users” and profiles one young woman, Jessica Rychly, whose social identity was stolen by a Twitter bot when she was in high school.
4     The BBC has been caught out a couple of times for false equivalence. It famously had to apologise for giving airtime to the views of Lord Lawson, a well-known climate denier. This prompted 57 prominent environmentalists, including Jonathon Porritt and Caroline Lucas, to write to the Guardian (in August 2018) declaring: “We will no longer debate those who deny that human-caused climate change is real. There are plenty of vital debates to be had around climate chaos and what to do about it; this is simply no longer one of them. We urge broadcasters to move on, as we are doing.”

5     Disinformation in a pandemic is not new: the KGB ran a campaign in the 1980s, ‘Operation Infektion’, which spread the rumour that HIV/AIDS was an American biological weapon that misfired.

6    In the summer of 2019, Twitter shut down about 200,000 accounts that it said originated from within the People’s Republic of China saying they appeared to be part of a “coordinated state-backed operation” to “sow political discord in Hong Kong”, and in June 2020, Twitter removed 173,750 more accounts, 23,750 of which it classified as “the core of the network.”
7    An incident like Shamoon, the virus that wiped data from 30,000 computers at Saudi Arabia’s state-owned oil company in 2012 may have been payback for the Stuxnet attack that damaged 1,000 Iranian uranium-enrichment centrifuges (believed to be the work of Israel & the US).  
To Be Provided
Share by: