Wednesday, 14 July 2010

Judgement Day? AI + HFT = Entropy?

'Letting the Machines Decide'


A new wave of investment firms are turning to artificial-intelligence programs to make trading decisions. The programs are designed to crunch numbers, learn from decisions, and adapt. Some are having success.
 
Q. Does AI offer any more predictability or safety than human herding - don't forget who write the algorithms in the first place. BUT what happens when different AI trading platforms sense the movements of other AI platforms - since BUY/SELL is a wholly devisive arrangement then surely the system could create a raft of unexpected outcomes??
 
HFT will make cause-effect more entropic - even media may be unable to keep up with nano-second trading. Private investors become ever-remote, is this another way for the industry to regain control and instil some fear factor AND at what cost?
 
Article

No comments:

Post a Comment

Note: only a member of this blog may post a comment.

Quote of the day: "Great spirits have always found violent opposition from mediocrities. The latter cannot understand it when a man does not thoughtlessly submit to hereditary prejudices but honestly and courageously uses his intelligence." Albert Einstein (attributed)

Investment U


Delta changes in risk aversion (Nov09)

Sentiment: The 'Lag' Effect

Sentiment: The 'Lag' Effect
Investor perception of risk is rarely up to date

Global Consciousness Project (GCP) 'Dot'

The Global Consciousness Project collects random numbers from around the world. This is a real time data analysis of the GCP. It collects the data each minute and runs statistics on the stream of random numbers generated by the project. This analysis is run 10 minutes behind the generation of the data. In this way, it can be seen as a real-time indicator of global consciousness coherence. http://gcp.djbradanderson.com/ BLUE DOT: Significantly small network variance. Suggestive of deeply shared, internally motivated group focus. The index is above 95% BLUE-GREEN DOT: Small network variance. Probably chance fluctuation. The index is between 90% and 95% GREEN DOT: Normally random network variance. This is average or expected behavior. The index is between 40% and 90% YELLOW DOT: Slightly increased network variance. Probably chance fluctuation. The index is between 10% and 40% AMBER DOT: Strongly increased network variance. May be chance fluctuation, with the index between 5% and 10% RED DOT: Significantly large network variance. Suggests broadly shared coherence of thought and emotion. The index is less than 5% The probability time window is one hour. For a more information on the algorithm you can read about it on the GCP Basic Science page

Choosing Mutual Funds..

Choosing a Mutual Fund – CLUE “it is not about past performance.." You could try - Logic Scoring! The trick is to create your own metrics and populate them into your own grid.. Always remember to test your assumptions v outcomes: your model may be right but you may find what you thought to be a SELL is actually a BUY. Always look at the problem in the mirror! You can also read this in conjunction with my guide on Value at Risk and other Key Risk Indicators below. http://tinyurl.com/ydvf3zh

Bull versus Bear Investing; versus Herding

The lifecycle (or holding period) of an investment held by a particular investor, often categorised as short, medium or long-term.

Let's get normal volatility out of the way first.. VaR-based toolkit.

Ok - a starting point - let's get normal volatility out of the way first.. This pack was written around end Q308 - post 16/8 but before the massive movement of Oct-Nov08. For those who support brownian motion or the geometric movement of returns then, I'm afraid to say, it's going to end bad..

What is the fuss with volatility.....

Re the movement of market returns - many believe they follow a geometric or exponential Brownian motion ('GBM') which is a continuous-time stochastic process in which the logarithm of the randomly varying quantity follows a Brownian motion, also called a Wiener process. It is used particularly in the field of option pricing because a quantity that follows a GBM may take any positive value, and only the fractional changes of the random variate are significant ('deltas').

http://en.wikipedia.org/wiki/Geometric_Brownian_motion


So in practice 'brownian motion' assumes a strong tendency to trend - it says that returns won't jump from day 1 to day 2 but move up and down in fairly predictable increments.. the returns of the previous days have an impact on the subsequent day - they are not unique. This estimation of how prices move is the underlying principal for the future pricing of derivatives contracts such as options.. i.e. E.g. to buy a contract, at one price, to buy or sell the underlying asset at a future date at a future price... this is usually referred to as the 'Black-Scholes formula' or the much much earlier Bronzin model (1908). This ties up with the old-age 'law of big numbers' (or law of averages) - where returns follow a pattern around a mean and that the volatility around that mean diminishes over time.. Where those returns are then assumed to form a normal distribution (or bell curve) then the 'GBM' is symmetrical to the mean of those returns. BUT what if we do not believe upside and downside returns will be similiar?.
A LOT of analysis has been run since to dispel this view such as many variations of the the Noble winner Robert Engle's ARCH approach in 2003 ('heteroskedasticity'.. or the analysis of different dispersions/volatilities), countless variations thereof, stochastic models (see below*), extreme loss analysis, stress testing, scenario analysis and so on - it keeps the Math boys busy shall we say...

*Stochastic models: treat the underlying security's volatility as a random process, governed by variables such as the price level of the underlying, the tendency of volatility to revert to some long-run mean value, and the variance of the volatility process itself, among others. Somtimes I use Markov chain as the easiest way to visualise and understand a random process: usually it's illustrated by the cat and the mouse:

Suppose you have a timer and a row of five adjacent boxes, with a cat in the first box and a mouse in the fifth one at time zero. The cat and the mouse both jump to a random adjacent box when the timer advances. E.g. if the cat is in the second box and the mouse in the fourth one, the probability is one fourth that the cat will be in the first box and the mouse in the fifth after the timer advances. When the timer advances again, the probability is one that the cat is in box two and the mouse in box four. The cat eats the mouse if both end up in the same box, at which time the game ends. The random variable K gives the number of time steps the mouse stays in the game..

This Markov chain then has 5 states:

State 1: cat in the first box, mouse in the third box: (1, 3)
State 2: cat in the first box, mouse in the fifth box: (1, 5)
State 3: cat in the second box, mouse in the fourth box: (2, 4)
State 4: cat in the third box, mouse in the fifth box: (3, 5)
State 5: the cat ate the mouse and the game ended: F.

To show this for a fairly infinite number of price movements is somewhat less achievable but nonetheless that's what the clever bods have done..

Otherwise most of probability, I admit, is above my head unless it descends into some sort of practical application - BUT I get the sub-plot.. stop trying to predict future patterns from regressing past performance... show me the track record of a model (after it has been created) and I'll be one step closer to being converted.. I'll touch on stress testing, extreme analysis ('extremistan') and scenarios another day..

"The Black–Scholes model disagrees with reality in a number of ways, some significant. It is widely employed as a useful approximation, but proper application requires understanding its limitations -blindly following the model exposes the user to unexpected risk. In short, while in the Black–Scholes model one can perfectly hedge options by simply Delta hedging, in practice there are many other sources of risk." Wikpedia

http://en.wikipedia.org/wiki/Black%E2%80%93Scholes





Active-Passive Investing Debate

Performance Patterns: **This deck is based on some work-based research so apologies for the confusing arguments - as a consequence the 'story' in the slides is a little muddy so I will re-jig this in the New Year to make my points clearer.** Passive-active purchase drivers in the UK are less differentiated/defined than perhaps elsewhere; the basic rules apply: What I did find was that there were interesting herding flows preceding, into and of the credit crunch. These were large asset-class movements: something which active managers would have little control of unless they ran absolute return type startegies. What my analysis showed is that an investor could manage a passive portfolio tactically to take advantage of large herding patterns. This involves risk, access to the right data, practice and above all discipline but I hope it will be a journey we can share!!

Lessons for 2010 - REIT Funds

Noting the events around 2005-2008 make for interesting considerations when thinking about buying REIT Funds in 2010..

The UK Investor - The Surprise Factor

The maps in the presentation (below) really help illustrate the suprise factor of the credit crunch.. little of the previous patterns would prepare the UK investor for what was about to come. The flows show that investors did not recognise the risks inherent in 2006-2008. This is because the industry uses conventional fund metrics, which were at best outputs not guides..!

The UK Investor - IMA 'Map' 2002-2008

Jon Beckett, ASCI - Past Projects (2003-2008)

I have been involved in the IFA and investment market since 1998, covering a broad range of roles. I have engaged a number of industry bodies over the years, to be a voice for change, to reform our industry and make it trusted and respected. None of the projects shown should be related to Franklin Templeton either: explicit, inferred or otherwise. I attach some of my past projects from 2004-2008.. Rgds JB