Best Practices

So What the Heck Is SUBICO?

So What the Heck Is SUBICO?
clock
2 min 19 sec

Callan is committed to original, path-breaking research to help educate the financial industry and serve our clients. That commitment began with the firm’s founding and continues today with a research operation that spans every major asset class and investing strategy.

One of the latest examples of our research stemmed from an attempt by Greg Allen and Ivan “Butch” Cliff to help institutional investors with a challenge they face in evaluating managers: “survivorship bias.” This refers to the fact that typically the results over a period of time for a universe only reflect the outcome for the “survivors,” not the total universe of members at the start of the measurement period. In other words, it is the logical error of focusing only on the things that survived a process while ignoring the things that did not.

This bias has real-world implications outside of investing. In a famous example, World War II aircraft designers decided to study the planes that returned from bombing missions over the European Theater to improve survival rates, by examining the flak damage and bullet holes in those aircraft. At first they planned to reinforce those areas. But they realized they needed to add armor in the places that were not hit in the survivors, especially the engines, on the theory that those were the places where damage brought down the aircraft that did not return from missions.

Survivorship Bias

For investors survivorship bias is important because it skews the analysis of investment managers, resulting in both an overly pessimistic view of the skill of managers whose strategies have survived over time and an overly optimistic view of the effectiveness of a class of investment strategies.

Solving the problem of accounting for the track records of those managers who did not endure over the entire time period is no easy mathematical task. Working with Walter Meerschaert, our manager of information technology, Allen and Cliff developed a technique they call “SUBICO,” for SUrvivorship BIas COrrection. Using sophisticated mathematics, it “fills in” the records of the missing managers. And it avoids the problems of some simpler techniques by correcting for bias across the full distribution of results (i.e., from the 1st to the 99th percentile) and can be applied to other return metrics, such as the Sharpe ratio and correlation. Other techniques may provide a rough sense of the median return but cannot offer results allowing that range of evaluation tools.

FYI

Survivorship bias: The logical error stemming from the results over time for a universe only reflecting the outcome for the “survivors,” not all the members at the start.

Posted by

Share
Share on facebook
Share on twitter
Share on linkedin
Related Posts
Operations

The Cobbler's Shoes

Greg Allen
Callan analyzed 401(k) plans sponsored by investment managers to identify trends of value to the defined contribution (DC) plan industry
Private Markets

Risk Parity: Silver Bullet or a Bridge Too Far?

Greg Allen
This post provides a high-level summary of “Risk Parity: Silver Bullet or a Bridge Too Far?” a chapter by Greg Allen in a recent book published by...
Operations

Active or Passive? Our Data Can Help

Ivan "Butch" Cliff
Operations

2017 National Conference: On Challenges for Institutional Investors

Stephen Trousdale
Macro Trends

'Perfect Capitalism' and the Future of Technology

Stephen Trousdale
Macro Trends

2017 National Conference: On Long-Term Financial and Economic Trends

Stephen Trousdale
Private Markets

Private Real Estate Debt and Middle Market Direct Lending

Stephen Trousdale
Macro Trends

2017 National Conference: On the Rising Opposition to Globalization

Stephen Trousdale

Callan Family Office

You are now leaving Callan LLC’s website and going to Callan Family Office’s website. Callan Family Office is not affiliated with Callan LLC.  Callan LLC has licensed the Callan® trademark to Callan Family Office for use in providing investment advisory services to ultra-high net worth clients, family foundations, and endowments. Callan Family Office and Callan LLC are independent, unaffiliated investment advisory firms separately registered with the Securities and Exchange Commission under the Investment Advisers Act of 1940.

Callan LLC is not responsible for the services and content on Callan Family Office’s website. Inclusion of this link does not constitute or imply an endorsement, sponsorship, or recommendation by Callan LLC of their website, or its contents, and Callan LLC is not responsible or liable for your use of it. When visiting their website, you are subject to Callan Family Office’s terms of use and privacy policies.