William James and John Maynard Keynes on Deciding Better

I’m indebted to Glen Alleman for pointing out that John Maynard Keynes wrote a book on probability, A Treatise on Probability which starts with the Bayesian view of probability as belief and moves on to explain how Frequentist concepts fit into the Bayesian world view.

Herding Cats: Books for Project Managers: “Each paragraph in the book provides insight like this. Two paragraphs later is the core of the current ‘black swan’ of probabilistic management. There is a distinction between part of our rational belief which is certain and that part which is only probable. The key here is there are degrees of rational belief and if we fail to understand, and more  important, fail to ‘plan’ in the presence of these degrees, then were are taking on more risk and not knowing it. This is a core issue in the financial crisis and managing projects in the presence of uncertainty. “

This relationship between belief and probability is an important basis for decision making, forming the bedrock of what I see as the American philosophy of Pragmatism, Its a bottom up point of view that is rooted in experience and practicality. William James, who codified this point of view as “Pragmatism” famously said, “Truth is what works”.

Exploring a bit of this Keynes book already and knowing that Keynes was influenced by his Cambridge associations with G.E. Moore who similarly took this bottom up, individual belief based approach most famously in Principia Ethica. So perhaps this Cambridge-Bloomsbury connection makes this really Anglo-American philosophy.

There was a time when our search for truth as a culture led us into periods of severe doubt and Continental philosophies like Existentialism and Deconstructionism. These were times of great shifts in values and cultural upheaval. Arguments from first principles were swept aside by feelings of being without roots in a world without intrinsic meaning.

For James, Moore and Keynes, there’s a grounding in the pragmatic idea that there is a real world out there that we can know and predict however imperfectly. Decisions based on our beliefs have consequences so we had better work on refining those beliefs and improve our decision making.

Perhaps we’re ready for a return to a more practical Anglo-American philosophy based on experience, culture, belief and the scientific approach to finding meaning in the world. At least I know I am.

The Metalevel: Computational Paths to Human Understanding

I’ve got to hand it to Evan Williams. It’s not an accident that he’s been at the start of these large Internet developments.

GigaOm:

“OM: Do you think that the future of the Internet will involve machines thinking on our behalf?

Ev: Yes, they’ll have to. But it’s a combination of machines and the crowd. Data collected from the crowd that is analyzed by machines. For us, at least, that’s the future. Facebook is already like that. YouTube is like that. Anything that has a lot of information has to be like that. People are obsessed with social but it’s not really “social.” It’s making better decisions because of decisions of other people. It’s algorithms based on other people to help direct your attention another way.”

This is exactly where I think we are in the evolution of the extension of the mind by global computer networks. We are individual nodes or modules taking in information and producing behaviors. We’re individually limited in bandwidth both coming in and going out. Those are human constraints that have some fixed limit based on biology and time.

There’s an aggregated metalevel that’s too big for us to see individually, but can be looked at computationally by our machines and fed back to us as processed information. By analogy, the visual part of the brain has only indirect access to somatosensory input from the fingers, but gets access to the synthesized information to refine visual analysis.

This isn’t just limited to the internet. Another good example is how the genome, endless strings of four bases, can’t be interpreted by inspection. Its just two much information. But we very quickly developed computational methods to show us the patterns for human interpretation.

These are examples of complex, networked systems that require computation analysis for human understanding.

Steven Strogatz: Sync

Steven Strogatz has been one of the leading figures in the mathematics of biological systems. While synchronization of independent elements is the thread that brings his book  Sync together, it’s all in the context of the new systems view of biology.

His process is to frame a question about complex systems and then look for answers by running computer simulations of the process. When order emerges in the simulation, he and colleagues try to discern the mathematics underlying the order. You see these connections are so complicated that one can’t predict their behavior by inspection and reason. In general, its easier to recreate aspects of them in a simple model in order to understand how they behave.

This is a very basic demonstration of emergent behavior of a system. The behavior of the larger system can’t be predicted by understanding the behavior of the components and their interconnections. Even more interesting is how small changes to the indivual units or their connection strength can radically change the emergent bahavior of the system. Once you have a simple working model, deeper understanding of the possible states of the system can be gained by looking at behavior over a wide range of assumptions and conditions. Here Strogatz is interested in how synchronous activity emerges in networks.

These simplified systems aren’t real, but are useful tools. Just as a map is not the terrain, a system model is not the system itself. The model is useful only if it predicts the behavior of the real system. Just as a map is only useful if it can predict the proper route through the landscape. This is the iterative nature of science and a reflection of William James’ Pragmatism. Truth is what works.

As a scientist, I gained a bit of insight into why it’s easy to manipulate the state of some biological systems. I spent many years in the lab studying mechanisms of cell death. I could never understand why so many investigators were able to find so many different ways to halt the process once it had been set in motion by an experimental perturbation. Surely all of these processes couldn’t be independently responsible for the cell death? If they were independent, then blocking just one wouldn’t help cells survive. Other, unaffected processes would carry out the deed.

The many interactions within a cell place some events at nodes that have broader effects. The other day, an accident on a highway here in Baltimore managed to tie up much of the traffic north of the city. There were cascading events as traffic was shunted first here and then there by blockage and congestion in one key pathway after another. Similarly, cell processes or cell state can be shifted from one state to another by strategic triggers.

Tools like network maps and simulations promise to provide a means for understanding complexity that won’t yield to simple cause and effect diagrams. Strogatz ends the book with some contemplation of how consciousness arises from the network of neural connections. It may be that syncronization across the cerebral cortex is responsible for the binding of shape and color of visual objects or the binding of object and word.

Of course, its this idea of mind and meaning as the emergent effect of complex systems that has interested me for some time now. As a neurobiologist, calling meaning an emergent quality of brain is a neat way to bridge the material with the immaterial worlds.

Expresscard SSD In The MacBook Pro

Everyone who is using a recent MacBook Pro should be doing this remarkable, cheap upgrade. You need an MBP with an Expresscard slot. And it needs to be bootable. Apparantly, Apple enabled this only when the moved to the Core2 Duo processor, designated as 3,1 and 4,1 models. When they went to the unibody MBP series, the Expresscard disappeared from all but the 17″ model.

But if you’re lucky enough to have an Expresscard 34 slot, hurry over to NewEgg and buy a 48 GB Expresscard SSD. It is without doubt the most remarkable upgrade I’ve ever done on a Mac. As I write this, its $106 dollars, free shipping. I got mine overnight from Edison NJ to here in Maryland.

You know how everyone is raving about the speed of the new MacBook Airs with their SSDs? Well this is a fast, PCI-E SATAII controlled drive. So you get an incredibly fast drive for just over a hundred dollars. It’s only 48 GB, but it turns out that a clean install of OS X 10.6 with basic apps is only 11 GB.  So there’s room for some apps and documents, but not mass storage of photos, music and movies.

But who cares? There’s a built in drive for that. Brilliant !And which the MacBook air doesn’t have!

After making sure I had a good Time Machine backup of the internal drive, I formatted the Expresscard SSD with Disk Utility and used the 10.6 install disk to put a system on the drive. The only trick was to choose options to make sure no other languages or unnecessary printer drivers are installed.

Then just boot from the SSD and you’re good to go. I use syncing through mobile me, so Safari bookmarks, calendars and mail accounts all came along instantly. I pointed iTunes to the big library on the internal hard drive and all works fine.

So far, I’ve put my current project apps on the SSD: Tinderbox, Scrivener, and Evernote. So far I haven’t moved the Photography apps over.

Would I ever swap out the internal drive for and SSD? With 256 GB drives currently at $500, I’d much rather run my current configuration. In fact, I’d find it hard to move to a MacBook Air right now because I’d have to juggle storage more or move to a base Mac/ working portable configuration. Possible, but needed for now.

This is the future for PCs. We’re already enjoying it on the iPad and the MacBook Air is the next step. It will be interesting to see the evolution of storage in computers, but I can confidently predict we’ll be seeing SSDs feature prominently. Given the size of the actually parts compared to rotating magnetic drive, I wouldn’t be surprised to see the MacBook Pro revision come with both an SSD and magnetic storage.

Some Background

A bit about me. Really.

I earned an MD and a PhD in Neuroscience. I trained in Neurology at the Johns Hopkins School of Medicine and was on the faculty for 10 years. During those academic years I did research on brain injury, taught medical students and residents and saw patients with a wide range of brain diseases.

Then, at age 40, I got my first job in the real world at a biotech and began to learn about making decisions. Of course like everyone else I had been making decisions my entire life. And as a physician, I made life and death judgments on an almost daily basis. But I never thought about the process of decision making. They say that drug development is one of the most risky businesses of all, second only perhaps to oil drilling. Every day in a drug development program brings new challenges to overcome and in the end, the vast majority of projects fail after having cost millions of dollars.

I decided I was going to become as expert in decision making as I was in Neurology. My writing here is the result of my experience. It combines all of my passions in what I think is an interesting eclectic mix, combining Decision Theory, Neuroscience and Philosophy. With a healthy dose of self-improvement and avenues for personal growth for a bit more than just intellectual stimulation.

This is the third iteration (more or less) of my weblogs. I’ve got most of what I’ve written in the past archived. Lately I’ve been compiling in Tinderbox to take a step back and start writing regularly again.

Belief As Probability Estimation

Belief is another way of describing an estimate of the probability of truth.

Facts about the world are sometimes clearly true or false.  These clear cut cases tend to be the less interesting aspects of the world. They are the dependable facts of the world like Newtonian Physics.

Yet science and materialist philosophy wants to deal in these “facts” and dismiss all else as belief and, worse “speculation”.

Everything in between may or may not be known true or false, but is not an undifferentiated grey zone. The likelihood of truth is probability from 0 to 100%. Some speculation is clearly very low probability and some is close, but not quite certain.

Sometimes this kind of probability can be analyzed mathematically, as when flipping a coin or playing cards. I know that flipping a coin gives me a 50% chance of heads and a 50% chance of tails. If my chances of getting on a plane depended on a coin flip I’d be complete unsure as to whether or not I’ll be leaving town. But if it depended on my drawing the King of Hearts from a deck of cards, I’d believe I was very unlikely to get on the plane.

Of course, more often its a complex state of affairs that makes me doubt I’ll be flying. I’m late in leaving for the airport and there are traffic and weather factors that can be known pretty well, but can’t let me be sure about whether I’ll be getting to the airport with enough time to get on the plane.

These statements about belief regarding a future state of the world are critical for deciding. Do we believe that the stock market will be higher next year than now?

More often when discussing belief, its more commonly stated in the present. Do we think its raining now? Do we believe that vitamin C is good for treating colds? Do we think the new drug can improve memory in patients with Alzheimer’s disease? Or the past- do we believe that Barack Obaama was born in the US?

Interesting, most of these questions of belief are important in the present because of how they will affect our present actions. And those present actions reflect choices that are aimed at influencing future states of the world. If I believe its raining, I will choose to take an umbrella. The truth of whether its raining will result in either my being happy I’m dry or unhappy that I’m dragging around an umbrella. I believe its likely the drug will be a blockbuster; I invest millions.

To me, it doesn’t matter whether we grab that umbrella without thinking or after 15 minutes of consulting internet weather sites and considering the burden of various umbrella choices in the event that it does or does not rain. Instinctive decisions or analytic decisions are based on beliefs that are probabilistic statements about the past, present and future.

Uncertainty in the world is way too complicated to submit to constant rigorous analysis. And too much analysis costs time and effort. But fortunately our brains are great estimators of probability- what we call belief. By honing the sense of probability, we probably can become better deciders through having more practical sets of beliefs: understanding the world and adjusting our beliefs to be more accurate, more predictive.

The glow of night



Garden Night, originally uploaded by jjvornov.

This image was captured as the light was fading. You wouldn’t think that the conditions were right for photography, but with the high ISO abilities of today’s DSLRS and an fast prime (35mm f/1.8 DX).

How the Mind Controls the Brain

The study of the brain is really only about 150 old. And as recently as 100 years ago there were arguments about whether at least the cerebral cortex was intrinsically specialized or was some how able to assign any task to any part. We’ve made a tremendous amount of progress to the point that many neuroscientists are willing to talk about human behavior in terms of the brain, leaving consciousness and mind out of the equation.

This attitude generally called materialism or functionalism is placed firmly within the scientific tradition of studying only that which can be weighed and measured. While I’m a neuroscientist and professionally interested in the advancements of brain science, I’ve always found this disregard of mind troubling. Its as if the most important part of human experience is being ignored or, worse, just explained away.

I’m reading Michael Gazzaniga’s Human: The Science Behind What Makes Your Brain Unique. Its full of great insight into brain science as one would expect from one of the leaders in the study of higher functions of the brain. But in the latter half of the book, as he tackles the tougher questions, I get that old feeling that mind is being dismissed as being some how unreal and not worthy of study. There’s this dichotomy created between “instinct” and these unexplained “rational” agents that he seems to want to make the part of the brain that we experience as mind.

For example, Gazzaniga has a nice discussion of the data showing that the mind frequently makes up reasons for actions after the fact. This post-hoc rationalization by the mind is especially true for emotions triggered in a way that avoids conscious awareness of the input. Normally, emotionally charged stimuli like disturbing photographs go to all parts of the brain simultaneously, so the mosaic of the brain acts in concert. Our minds are normally in sync with our feelings.

One dramatic example is the split brain patients that Roger Sperry and then he, Gazzaniga, studied. These patients have had surgery for severe, uncontrollable seizures. In an attempt to stop the spread of seizures, the major connection between the right and left half of the brain was surgically cut. Sperry described how these patients can appear to have two minds in one brain. If, under experimental conditions, information is presented to half of the brain only, the other half doesn’t have access to the information. So if half the brain is asked to do something, for example peel and eat a banana, the other half of the brain doesn’t know why. When asked, the ignorant other half makes up plausible rationalizations, saying for example, the banana looked tasty.

In normal volunteers these effects can be studied with presentations of pictures for a very short time, too short to percieve consciously. They register and can provoke feelings that are not available to conscious perceptual systems. So the subject rationalizes why an emotion is being felt. It seems likely to me that this kind of rationalization occurs in people with mood disorders. Even if the mood is generated internally, one will tend to explain it based on external events.

Some one who’s depressed will walk through life seeing many things as depressing just to rationalize why they feel sad.

Materialists like Gazzaniga want to use this kind of data to convince us that all there is is brain. These mental agents in the brain are just some kind of internal explaining agents, which of course makes the brain the motive force for an individual. The mind becomes like some kind of narrator trying to make sense of it all.

Yet there’s a very telling phenomenon called reappraisal that shows that mind does affect emotion. It’s a two way street.

An external event can trigger a strong emotion. For example some one yelling and shouting stirs up all kinds of feelings in us. But as soon as we realize that the shouting is not at us, but at some one else, the emotions melt away quickly. When you realize that the police lights in the rear view mirror are just passing and not pulling you over, the fear turns to relief. There’s almost a limbic decay constant you can feel as the feeling evaporates over a few seconds.

As john Searle points out, materialists have an easy time going from brain to perception, but a much harder time seeing mind affecting brain, mind being causitive. The problem is that because they dismiss mind as being unreal, they are left with this strange residual of consciousness that we all percieve, we all think is causative in the world, but doesn’t seem to really exist. How can something that isn’t real do anything? These strict materialists end up sounding like dualists because they recognize brain and brain events only. The mind is unexplained except for being some kind of hidden brain process.

Adopting the attitude that mind is real, embodied in the brain, allows one to see the role of mind in the world. And there is a fascinating interplay between the mind and perception of the world, both external world and the internal world of body signals like hunger and fear.