A young but earnest Zen student approached his teacher, and asked the Zen Master:
“If I work very hard and diligent how long will it take for me to find Zen.”
The Master thought about this, then replied, “Ten years.”
The student then said, “But what if I work very, very hard and really apply myself to learn fast – How long then ?”
Replied the Master, “Well, twenty years.”
“But, if I really, really work at it. How long then ?” asked the student.
“Thirty years,” replied the Master.
“But, I do not understand,” said the disappointed student.
“At each time that I say I will work harder, you say it will take me longer. Why do you say that ?”
Replied the Master,” When you have one eye on the goal, you only have one eye on the path.”– Zen Parable
In a world obsessed with objectives, what can we learn from not having any? Much more than you think, according AI researcher, Kenneth Stanley.
Stanley’s findings come from an online application called Picbreeder. Picbreeder allows users to ‘breed’ an image by branching through variations of it. Each time a new parent gets selected, and the process repeats. Users can publish any interesting images they manage to find. Others in turn may use these as a starting point for further breeding. The experiment has produced a variety of interesting images; a remarkable feat given that the initial image was simple blob.
What’s fascinating is how these images get discovered - by not trying to discover them. Almost every interesting image had a parent which in no way resembled the final product. There was no way to tell it would end up producing that final image. You had to ride the goalless path, and see where you’d end up.
Many of the interesting images get produced in 70 to 90 generations. Peanuts for a computer to crunch through. Could traditional objective based machine learning reproduce these results? Stanley’s team tried their best. Even after 30000 generations, each time the experiment was a dismal failure. The machine images looked nothing like the remarkable images discovered by humans in a fraction of the attempts.
A similar project to Picbreeder, the Living Image Project, relied on voting instead of branching. Users would vote for a the variation that they wanted to be the new parent, and the majority would decide. Yet despite far more activity, the images produced by the Living Image Project were boring in contrast to Picbreeder.
Some observations and notes:
- Objectives can, ironically, be obstacles to innovation and creativity.
- It’s amazing how rich the discoveries on a goalless path can be.
- More amazing is that those discoveries wouldn’t have been found if the goal was to find them. One reason for this is deception in search. Sometimes you are on the right path, but it looks like a dead end. Other times it looks like the right path, but it’s actually a dead end.
- Objective based search is about finding things. Novelty based search, or goalless search, is about collecting stepping stones. A stepping stone is something that has the potential to lead somewhere interesting. Collecting stepping stones amplifies your ability to get anywhere.
- Objectives are prone to finding local maxima in complex search spaces. If you can see exactly where you need to go, then an objective probably makes sense. If you can’t then you’re probably going to hit a local maxima. Hitting the global maxima needs some adventuring.
- Diversity in stepping stones are important. Many interesting images got found in Picbreeder by starting with other semi-interesting images. It is important that others are following a different path to you. They might be laying down the stepping stones you need to make your greatest discoveries.
- The world has an obsession with objectivity, but following a goalless path is subjective. Interesting paths get taken by individuals based on intuition, and other instincts. We need to respect individual autonomy, and let humans do what they are good at - finding interesting stepping stones.
- Visionaries don’t see many stepping stones ahead to get to their inventions and discoveries. They see the stones that have already been laid, and realise that the next leap forward is merely one jump away.
- Vacuum tubes were used to make the first computers. If you had told vacuum tube makers in the 1800s, to rather work on the much more interesting problem of building a computer, we’d probably have no vacuum tubes or computers. The vacuum tube was a stepping stone.
- Consensus and majority based decision making lead to sub optimal results. Diversity is important. As is considering alternative paths. This reminds me of Mark Twain’s quote, “The majority is always wrong, the minority is sometimes right”.
- Many natural processes don’t appear to be objective based. Natural evolution and human innovation are cases in point.
- Funny meta point: Picbreeder was rejected by the National Science Foundation, because it was not clear what the project’s objective was. Stanley says the findings from it are his revenge. ;)
Stanley’s findings have many general insights applicable to all areas of our world and lives. It has given me plenty to think about in my own. Perhaps this is something that Zen masters have always known and respected.