Harry Seldon's blog

Fractals, Chaos, and Control Systems on Rails

Read

Controls vs Chaos, a simple illustration

Posted by Harry Seldon on February 14, 2010

A visualization of chaos is given by fractals. I showed you the pictures of fractal trees taken during a walk at the Parc de Sceaux after a snowfall in Paris. But I had taken a few more pictures of the very beautiful French garden of this Park.
A French garden (“jardin à la française”) is a nice illustration of control. Basically, the gardener controls the shape of the trees. The proximity of the natural trees with their fractal shapes and the gardened trees allowed me to take great pictures that show this contrast between chaos and control.

Let’s begin with my preferred one:
controlled_trees

I love the contrast between these cute spherically pruned trees and the majestic naturally shapped oaks behind. Notice that the apparent complexity of the fractal shape of the tree does not imply it is very difficult to prune a tree. It is more the size and the hardness of the branches that will decide how hard it is to prune the tree into a round shape.
Which tree shape is complex, the natural fractal shape or the artificial round shape? In terms of time, to accurately describe the shape, it is quicker to draw a circle than a fractal, so the circle is much simpler.
In terms of work to obtain the shape, it is the opposite. To get the fractal shape all you need to do is let nature do its job (with simple algorithms). To get a nice spherical shape you will need to prune the tree regularly. It is thus complex to get simple shapes.
Pruning a tree might not sound a complex process. However, the complexity comes from the fact the gardener will want to minimize his work on each tree. He will want to know the minimum frequency at which he needs to prune each of his trees. When in the season, which branch length (according to the tree halth), which tools, that makes many questions that complexify the control algorithm.
So yes gardeners as many other people do optimal control engineering without knowing it. Each time you ask yourself a question such as at which frequency should I do this, you are asking you the central question of control engineering. Too slow and you don’t get the performance you want, too fast and you overwork, you overconsume your energy.
A key factor of success is to do things at the good frequency. Unfortunately, this optimal bandwidth is complex to obtain.

To get back to the simple vs complex question, the key of the simplexity paradox lives in these points:

  • A simple natural algorithm leads to a complex shape.
  • A complex control algorithm leads to a simple shape.

More generally, we can sum this up like explained in this figure:
chaos_vs_control

Notice that the line from nature to artificial world is continuous. I am not excluding mankind from nature.
Notice also that this separation between a chaotical world and a controlled world is very similar to Nassim Taleb’s separation between extremistan and mediocristan. I had already quickly talked about this description of extremistan and mediocristan as unstable (chaotical) and stable (controlled) systems in a previous post.

Then, here are a few more pictures of the snowed gardened.
garden
Garden with naturally shaped trees in the background
conic_trees
Trees pruned in a conic shape.
cubic_trees
Trees pruned in a cubic shape.

Feel free to leave your comments.

Posted in , | 5 comments | Tags , , , , , , | atom

How did we get here? Chaos vs God

Posted by Harry Seldon on January 18, 2010

I love the description given by the BBC for their documentary “The Secret Life of Chaos” (which you can watch here).
As I have written a few articles about fractals, chaos and controls lately, I have added links internal to this blog to the text.

“Chaos theory has a bad name, conjuring up images of unpredictable weather, economic crashes and science gone wrong. But there is a fascinating and hidden side to Chaos, one that scientists are only now beginning to understand. It turns out that chaos theory answers a question that mankind has asked for millennia - how did we get here?

In this documentary, Professor Jim Al-Khalili sets out to uncover one of the great mysteries of science -

  • how does a universe that starts off as dust end up with intelligent life?
  • How does order emerge from disorder?

It’s a mindbending, counterintuitive and for many people a deeply troubling idea. But Professor Al-Khalili reveals the science behind much of beauty and structure in the natural world and discovers that far from it being magic or an act of God, it is in fact an intrinsic part of the laws of physics.

Amazingly, it turns out that the mathematics of chaos can explain how and why the universe creates exquisite order and pattern. The natural world is full of awe-inspiring examples of the way nature transforms simplicity into complexity. From trees to clouds to humans - after watching this film you’ll never be able to look at the world in the same way again.”

Notice that this introduction can be sum up by “Chaos vs God” or “Chaotical Design vs Intelligent Design”. However, anyway, one question remains: who created the laws of physics? Or how were created these laws of Physics, if you prefer ;-)

I have often privately said that James Gleick’s Chaos book gives clearer answers than the Bible about our world. Now is the time to say it publicly!

Enjoy the documentary!

Posted in | no comments | Tags , , , , | atom

The Secret Life of Chaos (BBC 2010)

Posted by Harry Seldon on January 18, 2010

The BBC aired on Thursday, January 14th an excellent documentary about Chaos, Fractals and Nature. You can watch it right here thanks to YouTube. If you are in UK you can also watch it on the BBC website at this address.

I am glad the BBC helps making these subjects popular and fashionnable more than 20 years after James Gleick’s Chaos book.

Part 1

All parts follow.

Part 2

Part 3

Part 4

Part 5

Part 6

Enjoy!

Posted in | no comments | Tags , , , , | atom

The fractal Google logo

Posted by Harry Seldon on January 14, 2010

Thx Pixgeeks for reminding me of this nice Google logo involving fractals.

fractal_google_logo

It was in memoriam to Gaston Julia’s Birthday.

In case I need to precise, the fractals you see on the logo are called Julia sets because the French mathematician Gaston Julia described them first. However, most of my readers already know that, right? ;-)

To say something only initiated people can understand: “The Mandelbrot set contains all Julia sets”. (That is why the fractal on the left is actually the Mandelbrot set.)

You can check all google logos here.

Posted in | no comments | Tags , , , , | atom

Winter is the enchanting fractal season: Snow and Naked Trees

Posted by Harry Seldon on January 10, 2010

You probably already know that the snowflake and the tree branches are the canonical examples of fractals.

So, as in Paris we have the chance to have currently a lot of snow, I went to the “Parc de Sceaux” to make these wonderful pictures.
I only regret the sky was not as blue as in Normandy.

tree_snow_battle
Children making a snow battle under a magnificient fractal tree.

ghost_trees
Enchanting ghost trees.

forest_snow
Sceaux Castle Forest under the snow.

Sceaux_castle_snow
Sceaux Castle under the snow.
This picture will be the inspiration for a future post. Can you see why?

If you have pretty winter pictures you want to show, you are welcome to link to them in the comments.

Do not hesitate to contact me if for some reason you want the pictures in full size (5 MegaPixels).

Happy new fractal year!

PS: In the first picture the tree is not the only one to be naked, can you see the naked young lady in the picture?
naked_tree_naked_young_lady
Wow, this naked young lady under the naked tree must be freezing. ;-)

Posted in | no comments | Tags , , , , , | atom

Happy new fractal year!

Posted by Harry Seldon on January 10, 2010

fractal_tree_scales
Picture showing the fractal invariance of scale in a tree. Background is the Battle of Normandy (D-Day) Memorial, in memoriam to the allied forces who liberated Europe from the Nazi yoke, Caen, France.

I wish you to have all your wishes realized. But to be a little more accurate, I actually wish you to precisely know what you want and wish. Because wishes have a much better chance of becoming true if you can clearly formulate them.

That-is-to-say, in order to clearly know what you want, and how you can get it, you will need:

So, as you follow where I am heading to, yes I do wish you to be a full pilot of your own life, not a passenger. And do not forget “Goals are dreams with a deadline” as one says.

GNC

If you find your life is too much of a fractal it might be because you don’t control enough your life. It is normal to perceive the world outside of you as a fractal, with its good and bad news, with positive or negative black swan. But inside of you the way news affects you is very much under you control. The way you behave is under your control. World might be fractal, your mind might not if you master it.
All the fun of life is knowing what you can change and what you cannot.

To read more about the duality Fractals vs Control check this article about extremistan and mediocristan.

Be in control of the first thing you can readily control in that world: yourself ;-)

If you are interested in knowing more about how you actually control yourself, check the subject of NLP: Neuro-Linguistic Programmation.

Posted in | no comments | Tags , , , , , | atom

7 lifechanging books about fractals, chaos, nature, philosophy and even finance for the holidays

Posted by Harry Seldon on December 14, 2009

Mandelbulb
Mandelbulb by Daniel White

As we are still at the beginning of the holiday season, maybe you haven’t bought all your gifts yet. In that case, here are a few lifechanging books you can offer to your loved ones.
By lifechanging, I mean you will never look at the world in the same way after reading one of these books. There is even a good chance you will find the world a lot more simple after your reading because these books give you keys to the behaviour of nature and mankind.

If you don’t like too much specialized books, you will like these ones because each one of them will speak about several topics among geology, economy, biology, social sciences, and climate.

Moreover, you will find some element of answers for several popular questions of our days like:

fractals_nature_model

So, let’s go to the point, here are these absolutely marvellous books. Notice, they are somehow sorted by order of importance.

So, in case it was not clear, now you see why my Twitter name is @Fractalharry ;-)

You can propose other books in the comments.

Enjoy your reading.

PS I have linked to Amazon for your convenience but I don’t touch any commission!

Posted in | 3 comments | Tags , , , , , , , , , | atom

For Taleb's Black Swan's Readers, Mediocristan and Extremistan are Stable and Unstable Systems

Posted by Harry Seldon on November 02, 2009

As a control system engineer and Mandelbrot/Taleb fan, I want to bring this quick clarification (It will be worth a longer post another day):

Extremistan is the world of unstable systems (predicting a final state on an unstable system is a mathematical nonsense and predicting a transient state is computationnally impossible).
Extremistan is the fractal world of Mandelbrot.

Mediocristan is the world of stable systems (you can predict the final state and even the transient if you are good but it is already difficult to predict the transient state for a stable system).
Mediocristan is the Linear / Gaussian Paradise.

My conclusion (1) is that in order to be able to predict a system behaviour you need to be able to stabilize it, that is you need to be able to control it or equivalently speaking to regulate it.
I cannot predict what you are going to do tomorrow. But If I can order you what you are going to do tomorrow, then there is a good chance I can also predict what you are going to do !

Bonus thought
Linear systems are very rare. Most systems are non-linear. But control engineers use and abuse of linear systems. The important reason is that systems can be locally linearized. Then, locally, you can apply linear control tools. You can stabilize your system and because it is stable you remain in the initial local place and you remain stable. That is all the beauty of it. So yes, somehow, linear systems are not as rare as they seem. Otherwise, there would be no aircraft autopilots because aircraft or spacecraft dynamics are not linear systems.
About Economics / Aerospace comparisons, you can also read this post:
2 lessons Economics should learn from Aerospace

(1) (not engaging Taleb, he does not seem much against regulation, for instance he wants companies to be prevented from becoming “too big to fail” but he is probably less regulation prone than I am. I am for instance for a safety authority on financial products like there is an aviation safety authority in charge of certifying airplanes (FAA).)

Posted in , | 1 comment | atom

2 lessons Economics should learn from Aerospace

Posted by Harry Seldon on October 30, 2009

Let’s imagine that economy is an airplane. This airplane goes through a severe zone of turbulence, transforming the cruise in an heavily uncomfortable bumpy ride. Passengers start to complain, and feel more and more insecure. One of them finally calls the stewardess and asks: “What are the pilots doing ? Can’t they move us out of this unbearable situation ?” “Well… there is actually no pilot in this plane”, the stewardess answers politely. The passenger now gets really nervous, and says “What ??? Then we should run to the cockpit and try to do something before it is too late !”. The stewardess, feeling really sorry, replies with a “Uh, I’m afraid there is no cockpit in this plane, Mister”. And the story ends there, with the krach of the “economy” airplane.

I had read this little comparison a year ago already in a French newspaper. The author was Jacques Attali, a French economist. As a pilot, I have wanted to blog about this since that time.

To be a little more accurate, an analogy would assimilate companies to airplanes and market to Air Traffic Control (ATC). The problem is the market does not control anything. Imagine air traffic without ATC. Air space would be a mess. Aircrafts would collide all the time and basically nobody would trust air traffic. Finally nobody would take the plane. The air traffic system would be quickly dead. Yet, that is what is happening with the economy. Companies crash and collide because they have secant routes and nobody to help them. Economy is a mess. Most of the time ATC helps pilots by guiding them among the traffic and by giving them slots to take off and land. But sometimes ATC prevents pilots from going too fast to their destination because they would compromise safety of other airplanes. Unfortunately companies have no “market controllers” to talk to, hence the crisis.

Economy should learn 2 lessons from aerospace system engineering:

  • Systems must be controlled.
    An airplane is highly unstable. It can fly because it is very actively piloted. Air traffic is unstable too, it is controlled by ATC. In the same way economy needs guidance, navigation and control. To say it differently economy needs regulation.

  • Systems must be robustified.
    Even once an airplane is controlled and made stable there is still a lot of work to do to ensure that it is robust to all kinds of failures, even some non-anticipated failures.
    Economy needs safety engineers. Currently there is only one safety engineer for the economy. He is Nassim Nicholas Taleb, the author of the Black Swan and Benoit Mandelbrot’s spiritual son. Else financial engineers behave more like terrorists than safety engineers. OK it is a bit harsh.

I began this post by the first point. So let’s develop now the second point.
An airliner has redundancy by design. It has 3 flight computers (and more). It has 3 fly by wire circuits. It has 3 hydraulics circuits. It has 2 wings (just kidding). It has 2 pilots. To design the airplane there is a whole team of engineers whose only role is to evaluate and improve the aircraft safety. They will verify that the airplane is as black swan proof (rare catastrophic event proof) as it can be. For instance, they will check that in the case of an engine explosion the projections won’t cut all the flight control wires. Obviously, propulsion engineer (in engine companies) will make sure an engine does not explode but, all the same, aerospace safety engineers do not take anything for granted. So they study the worst cases and they robustify the system. Moreover, they also robustify the system without any specific case of failure. For instance, the logic behind having several circuits is as simple as “something could happen”. You do not always need to know the exact failure scenario to robustify the system. Obviously, nothing (and no human pilot) being perfect, there are crashes. However, it is still safer to be in an airplane than in a car.

To come back to business, notice that safety by redundancy is the 6th point in the absolutely excellent article ”The Six Mistakes Executives Make in Risk Management” by Taleb. The mistake is “We are taught that efficiency and maximizing shareholder value don’t tolerate redundancy”. (A blogger sums up the six mistakes here).
If you are a manager, don’t leverage too much your department. Don’t think that each competency must be hold by only one person. Don’t make your best to reduce all redundancies. On the contrary identify your key activities and put redundancy on it. On the short term, reducing all redundancy gives you more profits but on the medium term it leaves you exposed to very easy failures (a sick person, an expert who leaves, etc.).

To conclude I will point out that Taleb loves to compare financial analysts to blind drivers. Here is one of his last sentence: “There were so many wise people around, but whom does Obama pick? The same people who were driving a schoolbus blindfolded, who have now been given a bigger bus.” You can find the citation in this article: Black swan now elephant in the room

Posted in , | no comments | Tags , , | atom

Simplexity: Things are a lot simpler than they seem and vice versa

Posted by Harry Seldon on October 20, 2009

Have you ever heard of simplexity ?

Some systems are a lot simpler than they look like. For instance, let’s consider the shape of a tree. It looks complex, especially if you compare it with a straight line. However, if you have read Mandelbrot or heard of fractals, you know that all you need to draw a tree is a 2 lines pattern, which you repeat a big number of times introducing at each step some light randomness. You can model pretty easily this tree shape. At least you can generate at your will tree shapes. That is typically the way used in computer graphics to generate natural virtual 3D scenes. However, this does not mean you can predict the accurate shape of a tree from its seed.

So, is the tree shape complex or simple? Thanks to Mandelbrot we know now that the shape is a lot simpler than it seems. Associating the notions of predictability and simplicity, the converse is also true: it is more complicated than you could think even if you have heard of fractals. Hence this notion of simplexity, contraction of simplicity and complexity.

Here are a few good books on the subject:

If you know about fractals and chaos, you must be already familiar with that fact that simplicity can bring complexity quickly and easily. But you might not know this term of simplexity.
More generally, each time you think “this thing is a lot simpler than I had imagined at first”, you experience simplexity: in fact, you changed your first impression of overall complexity by discovering the underlying simple principles.

While we are at it. There is a field where simplexity shows all its magnificence: it is in finance. International finance looks complex but there are a limited number of principles behind it. You can even fairly easily model a stock chart. (Even if this model has nothing to do with the actual models used by financial analysts). But even with a good model you cannot predict easily the stock chart of a determined company.
For more info, you can have a look at the Facebook group “Finance & Mandelbrot”.

And at last, because I cannot prevent from saying it again, If you want to keep things simple, then regulate them. Contrary to what you could think, you do not need very accurate models to control a system.

Posted in , | no comments | Tags , , , , | atom

Search

Sponsor