Can stylometry tell who wrote Dominic Cummings' controversial statement?

· Thomas Wood
Can stylometry tell who wrote Dominic Cummings' controversial statement?

 One rule for the establishment, another for everyone else…

Owen Jones, The Guardian

Dominic Cumming’s statement in the Rose Garden

If you live in the UK it will have been hard to avoid the media coverage about Dominic Cummings’ trip to Durham just after the start of the Coronavirus lockdown.

What incensed many Brits further was his televised statement given on 25 May from the Rose Garden at 10 Downing St. Many were expecting an apology for flouting the strict lockdown rules, but instead heard a series of lukewarm excuses.

Suspicion about the writing style from the Financial Times

Dominic Cummings reading his statement in the Rose Garden at Number 10

Then Allen Green at the Financial Times did a fascinating analysis of how the wording of the statement has been put together by a lawyer, giving at least three reasons for every action in case any assertion is later refuted.

Fast Data Science - London

Need a business solution?

NLP, ML and data science leader since 2016 - get in touch for an NLP consulting session.

That got me wondering: did Cummings write his statement or his lawyers?

Forensic stylometry analysis

I have tried to find this out using forensic stylometry, the science of identifying authors by their writing styles.

I had some code lying on my computer from an earlier experiment where I investigated whether JK Rowling really did write The Cuckoo’s Calling. I collected posts from Cummings’ blog and a few other famous people in the political or public sphere and I calculated the similarity between the writing styles. (Incidentally, if you manage to read one of the lengthy posts on his blog from start to finish I will be impressed.)

When I calculated the probability of Cummings being the author, the results were inconclusive. My model gave a probability of about 50% that he wrote his statement. He was a more likely author than any of my other candidates.

[Stylometry](/natural-language-processing/fast-stylometry-python-library/) model output. Probability of likely authors of the Rose Garden statement

Probability of likely authors of the Rose Garden statement, based on personalities’ blog posts and writings and calculated using the Burrows’ delta algorithm.

Who really did write it?

I think that the reality is somewhere in the middle. Cummings probably drafted the statement and his lawyers made it legally watertight. The stylometry analysis is indicating he most likely made at least some contribution. This would make it a collaborative effort.

If you have a set of documents and you’d like to determine authorship, or simply extract data from them, I’d be keen to hear from you. Just write a comment or send me a message.

Unfortunately the Burrows’ delta method of stylometry, which I used, tends to perform best on longer texts like books. There has been research into stylometry techniques that use deep learning and word vectors (Jasper et al), and which are capable of identifying authorship of short documents, however this is much harder to do that Burrows’ delta.

References

  • Jasper et al, Authorship Verification on Short Text Samples Using Stylometric Embeddings, Lecture Notes in Computer Science (2018)
  • Evert et al, Towards a better understanding of Burrows’s Delta in literary authorship attribution, Proceedings of NAACL-HLT (2015)

Elevate Your Team with NLP Specialists

Unleash the potential of your NLP projects with the right talent. Post your job with us and attract candidates who are as passionate about natural language processing.

Hire NLP Experts

Getty Images v Stability AI trial concludes - will 'AI training havens' spring up in jurisdictions with lenient copyright laws?
Generative ai

Getty Images v Stability AI trial concludes - will 'AI training havens' spring up in jurisdictions with lenient copyright laws?

After this ruling, will tech companies move all model training to data centres that they consider “copyright safe”? Will we see a new equivalent of a “tax haven” for training AI models on copyrighted content? An “AI haven”? This article is not legal advice.

Natural Language Processing | What is NLP and how can it help my business? (video)
Natural language processingAi for business

Natural Language Processing | What is NLP and how can it help my business? (video)

This new video explains natural language processing: what it is, how it works, and what can it do for your organisation. Natural Language Processing (NLP) is a branch of Artificial Intelligence (AI) that focuses on giving computers the ability to understand human language, combining disciplines like linguistics, computer science, and engineering.

A/B test calculator (Bayesian)
Data science consultingAi for business

A/B test calculator (Bayesian)

This free A/B test calculator will help you compare two variants of your website, A and B, and tell you the probability that B is better. You can read more about A/B testing in our earlier blog post on the subject. You may also be interested in our Chi-Squared sample size calculator which will help you calculate the minimum sample size needed to run a Chi-Squared test, given an expected standardised effect size.

What we can do for you

Transform Unstructured Data into Actionable Insights

Contact us