"Kant described a mechanism as a functional unity, in which the parts exist for one another in the performance of a particular function.
An organism, on the other hand, is a functional and structural unity in which the parts exist for and by means of one another in the expression of a particular nature.
This means that the parts of an organism – leaves, roots, flowers, limbs, eyes, heart, brain – are not made independently and then assembled, as in a machine, but arise as a result of interactions within the developing organism."
— Brian Goodwin, How the Leopard Changed His Spots
If we try to cross this lake by following only the stepping stones that lead toward our objective, we’ll soon get stuck. But what if we let go of our objectives? What if we focused on trying to find new stepping stones instead? This is novelty search. Instead of looking for something specific, you look for something new.
Novelty search isn’t just random, it’s chance plus memory. Together, these ingredients do something interesting.
...Stepping stones are also combinatorial. Each new stepping stone we discover expands our potential to find even more stepping stones. Collecting stepping stones is a luck maximization algorithm. By collecting and combining stepping stones, we might arrive at our destination by accident, or somewhere more interesting!
Anyone can verify by simple observation two important facts.
The first is, that whenever humans design and make a useful thing they invariably expend a good deal of unnecessary and easily avoidable work on it which contributes nothing to its usefulness.
The second fact is that all useful devices have got to do useless things which no one wants them to do. Who wants car to get hot? Or to wear out its tires? Or to make a noise and a smell?