Thursday, June 4, 2009

A Response to "Sensemaking ok, but ACTION is what they need (Visuale)"

Enrico Bertini writes the interesting Visuale blog, and recently posted a piece arguing that our research quest for 'Sensemaking' misses the forest for the trees: in the creation and study of analysis processes, we are not actually supporting realistic scenarios where decision support is needed in a timely manner. Specifically, he says "visualization is useless if it doesn't help people take actions". While I don't necessarily agree that all our InfoVis research is barking up the wrong tree, I see his point. Some projects, such as my own Uncertainty Lattices, are specifically designed to help people make fast decisions about data. However, it is true that in the InfoVis, and especially in the sensemaking communities, we seem to focus on process before results.

I see his point in that many of the solutions we develop as researchers are decoupled from actual use. I think Shneiderman & Plaisant addressed this somewhat in their paper on MILCS (longitudinal case studies). The problem is indeed structural: we cannot prove real usefulness without long term deployments, and the incentive for such deployments is low in academia (and, these sorts of experiments are time consuming). We cannot become toolbuilders for business without careful (and publishable) follow up evaluations. So, what is the solution?

I think we could be doing great InfoVis research but also having an impact in the analytics world, especially business analytics. We need to partner more with those real world users of data... I would be elated to see some of the great ideas I see every year at InfoVis and other venues actually become real products. There is a gaping hole between the great research we do and the market.

However, I'm not sure that adding the constraints Enrico mentioned will necessarily lead to a situation of improved design, no matter how much design is improved by explicit constraints. Even a cursory look at the bulk of currently commercially available business analytics tools shows that they would never been acceptable to the 'academic' audience (due to poor information design, layout, and breaking well known constraints about human perception). On top of that, they are almost all ugly.

I recently saw a deployed visual analytic tool using dark blue text on a purple background. It was illegible. But it was deployed and paid for. And, it was working for the customer. I would argue that deployment success and ability to provide insight over exploration is not an indicator of quality design. This is the age old question of the mystery of product adoption by the market. Perhaps it is a factor of providing that immediacy Bertini mentions: the decision support in a short time; the answer rather than a lengthy exploration process. The hated fuel gauges might do that better than my own VisLinks. Great, if we are going for speed and quality of decisions and not depth of insight or potential for discovery. We need to separate the two, as they can't be supported the same way. Sensemaking is not about providing a single answer. That's artificial intelligence, or maybe even 'smart graphics'.

I agree completely on Data Mining vs. Visualization... I would sum it up to say the 'vs.' needs to become '&'. I think the strength for the future lies in closer ties between the two. We have 'data manipulations' as a step in every version of the InfoVis pipeline and in all visual analytics process diagrams, but too often the visualization is actually of some surface data, or the outputs of data mining. I think a closer coupling of the two, bringing vis as a 'box opening' tool for data mining will be important. My own thesis research as been looking at just this for statistical linguistic processes such as translation and information retrieval, and I hope to do more of it in the future.


Enrico said...

Hi Chris,

Thanks so much for your comment, it's very much appreciated and it helps me think more about this topic which I wrote in a rush.

I'm going to comment only where you don't agree with me.

I know very well the problem you mention of very ugly business charts and the like. Here I'm not saying that we have to imitate them nor that we have to satisfy all the fashionable wishes our clients have. But I think we have to realize there is a sort of orthogonal design space where a tool can be useful/not useful and well designed/badly designed. The main point here is that, even if it's hard to admit it, a badly designed tool can be useful! And conversely a well designed tool can be totally useless! Are we ready to accept that and cope with this reality?

But even more important than that is that a design can be both useful AND well designed. And when this happens it becomes more useful. So our job is not to go there and say that purple charts with black background is crap. It's obvious to us but not to our audience. Our job is to demonstrate that our designs are better! They work better, faster, clearer and are more pleasing. I've heard it many times already in our community and I think it is true: our challenge is to "educate" people and let them realize how USEFUL our solutions can be. If we compete on fancy graphics we are lost.

As for data mining and visualization well ... this is currently the most interesting area in our field. And I will post soon a work we have done on how visualization and mining can be integrated. So come back soon and you'll see.

P.S. I saw you here @ EuroVis, I'll try to catch you if I see you around :-)

chang said...

Excellent help! Thank you for this great tutorial!!
website development