STA Blog

‘Replication crisis’: Why academic research struggles in the real world

I read a lot – and widely. In part out of sheer curiosity, sometimes to delve into a new subject and then again to find interesting information I might use in articles and social media. Today I present one of the latter, an article written by Robin Wigglesworth for the Markets Insight column in the Financial Times newspaper late last year. I cut it out and kept it, choosing to use it this month, times of financial stress and media hype.

Over the last decade scientists have found that the results of research papers have been increasingly difficult to reproduce – the replication crisis – and thereby validate. Wigglesworth questions whether this is not just the case in medicine and psychology but also in financial markets. I’m sure you too have come across endless articles in so-called leading financial publications that reference papers by ‘Fellow & Friend’ on the efficient market hypothesis and price/earnings – or whatever.

Here I quote from the FT article: ‘This is the incendiary argument of Campbell Harvey, professor of finance at Duke University. He reckons that at least half of the 400 supposedly market-beating strategies identified in top financial journals over the years are bogus. Worse, he worries that many fellow academics are in denial about this.’ This from the man whose 1986 PhD thesis was about how yield curves predict recessions.

He believes that one of the culprits might be the academic system itself which incentivises young staff to publish something sensational in a prestigious journal in the hope of landing tenure. A more nuanced reason is what’s known a ‘p-hacking’ where ‘p’ is the probability of something happening by pure chance as opposed to being statistically significant. ‘P-hacking’ is when researchers overtly or subconsciously twist the data to find a superficially compelling but ultimately spurious relationship between variables’.

So: next time a financial salesman comes up to you with a proposal based on academic research that has been back-tested – Caveat Emptor!

Yield spread US Treasury 30-2 year (Chart courtesy of MetaStock Eikon by Refinitiv)

Posted in Finance, Markets, STA news, Technical Analysis, Technical Analysis Courses, Trading, Trending
Tags: , ,

The views and opinions expressed on the STA’s blog do not necessarily represent those of the Society of Technical Analysts (the “STA”), or of any officer, director or member of the STA. The STA makes no representations as to the accuracy, completeness, or reliability of any information on the blog or found by following any link on blog, and none of the STA, STA Administrative Services or any current or past executive board members are liable for any errors, omissions, or delays in this information or any losses, injuries, or damages arising from its display or use. None of the information on the STA’s blog constitutes investment advice.

Not ready to join? Stay Updated

If you want to learn more about membership and being part of the STA, sign up for our updates so we can keep in touch.


Monthly Meetings

The STA holds 11 monthly meetings in the City of London, including a summer and Christmas party where canapés and refreshments are served.


Latest Videos

As a service to our members, many of whom are unable to attend all our monthly meetings, we have been making videos of meeting presentations for several years.


STA Libraries

The STA has an extensive library of classic technical analysis texts. There are over 1000 books in the collection. It is held at the Barbican Library with a smaller...


Market Technician

Latest research and news

More Info

World Class Tutors

STA Course Lecturers

More Info


Be part of something special

More Info


View latest posts

More Info