Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search
 

Demeter

(85,373 posts)
63. The HFT Revolution: 6 Reasons Why High Speed Trading Is Taking Over the Markets
Sun Apr 1, 2012, 07:19 AM
Apr 2012
http://www.financialsense.com/contributors/cris-sheridan/hft-revolution-six-reasons-why-its-taking-over-markets

...I believe we should at least understand the basic reasons why HFT is revolutionizing the market since it appears almost certain that it will eventually dominate not just the stock market (as it does now), but also foreign exchange, futures contracts, and the derivatives market. More than likely, without any major changes by regulatory bodies around the globe, HFT will quickly gain asset-wide dominance of the entire global financial marketplace. Here are the six reasons why I believe this to be true:

1. Scientific or technological advancement and innovation

This one's a no-brainer. The only comment worth mentioning is that, as noted by others, some of the software being utilized for pattern recognition HFT goes back to Cold War weapons technology used for detecting stealth aircraft (see Kevin Slavin's TED talk presentation: How Algorithms Shape Our World). Also, a large number of the PhD scientists, computer programmers, and physicists that developed the supercomputers and software necessary for closely mapping the dynamic topology of "financial space" came straight out of CERN labs attempting to unlock the secrets of the universe by smashing atoms together near the speed of light. The only difference is that this technology is being used now to unlock the secrets of universal profit by smashing stocks, futures, and various currencies apart in the Large Hadron Collider that has become our markets. Has it been successful so far? I don't know, perhaps companies paying over a quarter of a billion dollars laying cables across the Atlantic just to shave 6 milliseconds from their trades says something.

2. High correlation of asset classes

Over the past two decades there has been a steady increase in correlation among various asset classes, most especially in the stock market. According to Hedge Funds Review, "The correlation of value and growth stocks to the performance of the S&P 500 has spiked from less than 0.3 in the 1991-95 period to 0.99 and 0.98 respectively over the past five years. The correlation of non-US stocks to the S&P 500 is up from 0.34 in the early 1990s to 0.85, while emerging market stocks have a correlation of 0.79 compared with 0.38 going back 20 years."

Cited in the same article above, Stuart Rosenthal, CEO of Factor Advisors, says that "correlation is the new risk" and that they see "no signs that cross-asset correlations will decline." Instead, he believes that the longer-term trend is up. So how does this relate to HFT you ask? Having a low or negative correlation between various asset classes, stocks, etc. is the fundamental building block of traditional portfolio management and the main way to realize the benefits of diversification. Complex quantitative models fine-tuned over the years by financial analysts determine just the right allocation of stocks, bonds, currencies, and other assets based on their relative correlation to one another so that the volatility of an investor's portfolio can be minimized. With correlations increasing, the traditional model of investing loses its effectiveness. If we put buy-and-hold diversification strategies on one end and HFT on the other, the move towards greater correlation shifts a greater percentage of capital towards research, development, and execution of speculative momentum trading with HFT leading the charge.

3. Opaque financial information / accounting data

Most companies can't afford a team of financial analysts to wade through 50 pages of financial reporting data in order to detect earnings manipulation and accounting irregularities. Furthermore, even if they could, that still doesn't guarantee they'd be able to decipher the complex quantitative pricing of a company's derivative positions. Warren Buffet highlighted this issue in his often quoted 2002 annual report by saying, "derivatives severely curtail the ability of regulators to curb leverage and generally get their arms around the risk profiles of banks, insurers and other financial institutions. Similarly, even experienced investors and analysts encounter major problems in analyzing the financial condition of firms that are heavily involved with derivatives contracts."

As the "major problems in analyzing the financial condition of firms" go up—especially through the pervasive use of derivatives—the process of discovering a company's intrinsic value becomes more costly. Successful traders have long circumvented this problem in connecting fundamentals to market price by simply relying upon pure technical and momentum based strategies. What's most interesting, however, is that this process requires little in the way of human intuition and more upon the strict adherence of a mechanical strategy. The best will even tell you that emotion simply clouds your judgment—something that machines don't have any problems with.

4. Volatility (HFT as applied calculus)

With market uncertainty posed by fear over a Eurozone collapse, war with Iran, political debt-wranglings, foreign exchange fluctuations, excess liquidity, central bank intervention, fat-tail or "black swan" events, and numerous other problems facing us today, it is no wonder the markets are highly volatile. Then again, the markets have always had more or less volatility—one of the major ways we define risk. So how do you minimize this risk to investors? The answer you'll often hear is through diversification and long holding time periods. That is, the less correlated your assets are and the longer you hold them the more likely you are to overcome the temporary ups and downs of the market. The only problem with this, of course, is that sometimes people end up buying at a market top and don't get back to even until ten years later, if at all. Thus, as many of us know, volatility can have drastic effects both in the short and long term and can defeat the most perfectly constructed portfolio.

So where does HFT fit in? At some point, someone must've thought: "Why don't we apply the basic rules of calculus to the stock market? A stock (or asset's) price is really a complex curve exhibiting non-linear behavior so, rather than trying to predict its direction, let's simply break it into a series of extremely small intervals that capture its motion in real-time. The faster our execution speed the more we can profit from the market's every move." When you consider that calculus revolutionized the field of mathematics and helped bring about the Industrial Revolution, applying its basic (and yet completely unorthodox) principles to the market is no trivial matter.

5. Cost of human capital

As mentioned previously, it takes a team of financial analysts to sift through all the companies they invest in to detect earnings manipulation and accounting irregularities. If you're a large investment bank you can afford it. If not, you simply pay for their expensive research. Either way, you're still spending a lot of money. Of course, that still doesn't include the various portfolio managers, brokers, and other high-paid positions that typically accompany a successful investment firm. With high frequency trading firms, machines do most of the work. No more portfolio manager, analyst, or broker. Instead, you have people that watch blips on the screen all day to make sure the machines are humming a profitable tune. For the most part, it's a self-running operation. To a large investment bank, hedge fund, or trading firm the math is pretty simple: Cut half your workforce, find someone to develop a new HFT strategy in futures contracts or the foreign exchange market, and rent out a few rows of servers co-located to the NYSE. Excluding the math geek(s), your costs of human capital have gone down dramatically. All further funds can go directly towards upgrades or expansion into colocation centers around the world.

6. Regulatory changes

The last reason for the HFT revolution (or the "Rise of the HFT Machine" as Nanex and Zerohedge refer to it) is largely accredited to measures enforced by the SEC some years ago in order to enhance and modernize the existing market structure. As told in Deus Ex Machina, "Regulation NMS (National Market System) minimized the required time of trade execution from the normal 30 seconds down to 1, making the dependency upon high speed computer-driven orders almost a necessity." Whether the massive 523 page document was a necessary overhaul of the extremely outdated market structure or a test case for the unintended consequences that result from poor planning, I'm not sure...perhaps both. Either way, according to Paul Rowady of the TABB Group, the regulatory changes made by the SEC that now favor high frequency trading will probably end up with explosive results. As he writes in Real-Time Market Data: Circus of the Absurd: "Like the lighting of a long fuse, the market structure we have today in US equities results from Regulation NMS. Intended to foster the competing forces of low costs (through competition) and high transparency (through a consolidated quote and last sale data-feed mechanism), the byproduct of these rules is essentially the mad frenzy over tiny slivers of liquidity that we have today. When mixed with increasing levels of automation since the 1970’s...the fuse that was lit with Reg NMS so many years ago just might be leading us to a bomb."

THEY'LL BE SORRY, TOO....

NONE OF THIS DATA MANIPULATION AND ELECTRONIC TRADING IS SAFE FROM BASIC COUNTERFEITING... INDEED, COUNTERFEITING BECOMES A PIECE OF CAKE...CHANGE A FEW BITS, AND YOU ARE LITERALLY GOLDEN.

THERE NEEDS TO BE SOME ENDURING CONNECTION BETWEEN A CURRENCY AND THE REAL WORLD OF LABOR AND RESOURCES. THERE AREN'T MACHINES BIG ENOUGH AND FAST ENOUGH TO CATCH CROOKS.

OR...IT'S BACK TO BARTER AND THE 1% GET SHUT OUT OF THE ECONOMY ALTOGETHER...SINCE THEY PRODUCE NOTHING OF VALUE... I COULD LIVE WITH THAT!
ONE BANK DOWN, AND IT'S TOO CLOSE TO HOME FOR COMFORT! Demeter Mar 2012 #1
The Supreme Court and the ACA: Is Health Care Unique and Does it Matter? Demeter Mar 2012 #2
Nightmare Scenario: Supreme Court Guts Public Healthcare and Guarantees Private Insurance Monopoly Demeter Mar 2012 #5
What Happens to Health Care if the Court's Conservative Activists Just Strike Down the Mandate? Demeter Mar 2012 #6
What's Going to Happen to the Affordable Care Act? Demeter Mar 2012 #11
Krugman: Healthcare Ruling Could Prove Supreme Court is Motivated by Politics, Not Constitution Demeter Mar 2012 #13
The Nine Circles of the ACA Garrett Epps Demeter Mar 2012 #28
Single-Payer or Bust Steve Erickson Demeter Mar 2012 #34
As Health Law Is Contested, Developing a Plan B Demeter Mar 2012 #38
I saw that too - and had the same reaction as your last sentence bread_and_roses Mar 2012 #15
Amen. n/t Tansy_Gold Mar 2012 #50
Fucking sad! n/t Hotler Apr 2012 #91
Gas Prices Explained Demeter Mar 2012 #3
Moody’s takes actions on seven Portuguese banks; Outlook negative Demeter Mar 2012 #4
Thomas Frank: How Americans Have Gotten Played -- Over and Over and Over Again Demeter Mar 2012 #7
Groupon shares fall on downward sales revision (the con job begins to unravel) rfranklin Mar 2012 #8
Well, it's 8:00pm. Time for the "Not Keith Olbermann Show Anymore". Fuddnik Mar 2012 #9
Robert Greenwald on the New Film 'Koch Brothers Exposed' -- the 1% at Its Very Worst Demeter Mar 2012 #10
Every Progressive Should Know About the "Budget for All" That Would Support the 99% Demeter Mar 2012 #12
Visa, MasterCard scramble after massive data breach Demeter Mar 2012 #14
10 Most Obscene Lifestyles Choices of America's 1% Elite Demeter Mar 2012 #16
Challenge the 1% EMAIL NOTICE Demeter Mar 2012 #17
The Shadow of Depression By J. Bradford DeLong Demeter Mar 2012 #18
While White House Emphasizes Easing Student Debt Burden, Fed Contractors Play Hardball Marian Wang Demeter Mar 2012 #19
The Age of Obama: What Went Wrong (and How to Fix It) By Van Jones Demeter Mar 2012 #20
Musical Interlude hamerfan Mar 2012 #21
How I will be spending April Fool's Day Tansy_Gold Mar 2012 #22
Gorgeous! Demeter Mar 2012 #23
Very lovely! DemReadingDU Mar 2012 #24
that is wonderful! nt xchrom Mar 2012 #29
No foolin'. . . Tansy_Gold Apr 2012 #86
Just beautiful Tansy. nt Mojorabbit Apr 2012 #97
Break Up the Big Banks, Says the Dallas Fed By Robert Reich Demeter Mar 2012 #25
White House Burning: Putting Out the Wrong Fire By Dean Baker Demeter Mar 2012 #26
A World Bank President We Can Get Behind? By John Cavanagh and Robin Broad Demeter Mar 2012 #27
after a lovely evening of dining on butter shicken w/ rice and cauliflower -- i find this xchrom Mar 2012 #30
Sweden backs limited tax on share purchases xchrom Mar 2012 #31
Organized Money From Cities, Unions and Churches Moving Out of Big Banks Demeter Mar 2012 #32
Matt Taibbi: Bank of America Is a “Raging Hurricane of Theft and Fraud” Demeter Mar 2012 #33
Love Matt Taibi. He tells it like it is, always. A raging hurricane of theft and fraud, and they mother earth Mar 2012 #53
Robert Reich / Lopsided Recovery: The Economy Is Rebounding ... Only Just for the Rich Demeter Mar 2012 #35
Tax Breaks Exceed $1 Trillion: Report Demeter Mar 2012 #37
Gretchen Morgenson: Wall Street Really Does Enjoy a Different Set of Rules Than the Rest of Us Demeter Mar 2012 #41
The Truth About the U.S. Postal Service By Jim Hightower Demeter Mar 2012 #36
exactly. it also fosters community - another sin bread_and_roses Mar 2012 #43
Demeter, once again, the work you do on this board is invaluable. Keep up the good work. I learn mother earth Mar 2012 #51
Was MF Global Worth More as a Carcass? Demeter Mar 2012 #39
Barcelona in the General Strike xchrom Mar 2012 #40
GERALD CELENTE PODCAST ON IRAN, INFLATION, GOLD AND MORE Demeter Mar 2012 #42
Child labour re-emerges in Naples xchrom Mar 2012 #44
Muppets 1 Gollums 0 (THE PEOPLE VERSUS GOLDMAN SACHS) Demeter Mar 2012 #45
Time for the Birthday Frenzy (Groan) Demeter Mar 2012 #46
happy birthday to your daughter! take care of your self xchrom Mar 2012 #47
Japan Production Decline Undercuts Signs of Recovery: Economy xchrom Mar 2012 #48
World’s Richest Gain $13 Billion as Batista Gets 8th Spot xchrom Mar 2012 #49
Austerity Measures Prompt Spanish Workers To Strike girl gone mad Mar 2012 #52
I think we need some musical interludes...music, by the numbers! Demeter Mar 2012 #54
Some great music here, Demeter! hamerfan Mar 2012 #55
That was the best recording I could find Demeter Mar 2012 #56
No, this is not from The Onion, or an April Fool's joke! Fuddnik Mar 2012 #57
morning xchrom Apr 2012 #58
Did the Kid get YOU up, Too? Demeter Apr 2012 #60
Sorry, Demeter. What happened to me was xchrom Apr 2012 #62
Children are a trial, whether they come with fur or not Demeter Apr 2012 #64
tis true xchrom Apr 2012 #71
Three Major Banks Prepare for Possible Credit Downgrades Demeter Apr 2012 #59
Sweden moving towards cashless economy Demeter Apr 2012 #61
The HFT Revolution: 6 Reasons Why High Speed Trading Is Taking Over the Markets Demeter Apr 2012 #63
Can America’s Descent Possibly Be Reversed? By Scott Lazarowitz Demeter Apr 2012 #65
A Primer for Those Considering Expatriation Demeter Apr 2012 #66
Part II: Important Consequences of Expatriation Demeter Apr 2012 #67
US House of Representatives Approves Plan to Destroy Medicare, Medicaid and Food Stamps Demeter Apr 2012 #68
Govt to keep info on Americans with no terror ties Demeter Apr 2012 #80
Republicans and Democrats Both Want to Kill You! Demeter Apr 2012 #81
Supreme Court Judges Have Access to Guaranteed Care, Shouldn’t You? By Rose Ann DeMoro Demeter Apr 2012 #69
Asset-backed securities markets improves-Fed survey WHOOPEE FOR THEM Demeter Apr 2012 #70
Iraq March Crude Exports Rise to Highest in Post-Hussein Era xchrom Apr 2012 #72
Gold is Manipulated (But That's Okay) Demeter Apr 2012 #73
How High and When to Sell? Demeter Apr 2012 #74
Charles Biderman: The Problem with Rigged Markets Demeter Apr 2012 #78
Nature of Self-Defeating Convictions Demeter Apr 2012 #75
After Six Months, a Look at What Occupy Wall Street Has Accomplished Demeter Apr 2012 #76
We Win When We Live Here: Occupying Homes in Detroit and Beyond Demeter Apr 2012 #77
Curacao’s central bank freezes credit Demeter Apr 2012 #79
Countries 'hoarding' crude oil, say analysts VIDEO REPORT Demeter Apr 2012 #82
Several Reasons Why Gasoline Prices are so High Demeter Apr 2012 #85
Why Don't Young Americans Buy Cars? Demeter Apr 2012 #87
No McMansions for Millennials Demeter Apr 2012 #88
China says manufacturing rises again in March xchrom Apr 2012 #83
IRS Audit Rate Nears 30% for Those Making $10 Million and Up Demeter Apr 2012 #84
I haven't posted one April Fool Demeter Apr 2012 #89
BHO Po_d Mainiac Apr 2012 #95
That's more like a nightmare than a joke, but I appreciate the effort Demeter Apr 2012 #96
BRICS leaders edge closer to setting up development bank xchrom Apr 2012 #90
Taking their cue from Chavez, who ate the IMF's and World Bank"s lunch in S. and Central America Demeter Apr 2012 #93
How I spent my April Fool's Day Demeter Apr 2012 #92
Musical Interlude hamerfan Apr 2012 #94
Latest Discussions»Issue Forums»Economy»Weekend Economists Seek a...»Reply #63