veneziaveneziaAVI conference


BEyond time and errors: novel evaLuation methods for Information Visualization

A workshop of the AVI 2006 International Working Conference

23 May 2006 - Venezia, Italy
AVI 2006 Home Page | Call for papers (txt)


  • [Jul'07] BELIV'08, a new edition of the workshop, will be hosted at ACM CHI 2008 in Florence, Italy on 5 Apr 2008. Deadline for submission is 30 Oct 2007. For more info see the BELIV'08 workshop website.

Workshop description

Controlled experiments remain the workhorse of evaluation but there is a growing sense that information visualization systems need new methods of evaluation, from longitudinal field studies, insight based evaluation and other metrics adapted to the perceptual aspects of visualization as well as the exploratory nature of discovery. We solicit position and research papers discussing proposed new information visualization evaluation methods e.g. new ways of conducting user studies, definition and assessment of infovis effectiveness through the formal characterization of perceptual and cognitive tasks and insights, definition of quality criteria and metrics. Case study and survey papers are also welcomed when clearly presenting general guidelines, practical advices, and lessons learned.


Tuesday May 23rd- Don Orione Artigianelli Cultural Centre
9:00    Introduction

Enrico Bertini, Catherine Plaisant, Giuseppe Santucci
Opening remarks
Evaluating Information Visualizations: Issues and Opportunities
John Stasko

Challenges with Controlled Studies

Lessons Learned  from Case Studies

Methodologies: Novel Approaches and Metrics

>>>  LUNCH 13:00 – 14:30
Methodologies: Heuristics for Information Visualization

Developing Benchmarks datasets and tasks

Discussion -  Next Steps
18:30 END

Topics of Interest

Topics include, but are not limited to:

  • Utility characterization and evaluation
  • Quality criteria
  • Metrics
  • Insight characterization
  • Synthetic data set generation
  • Taxonomies of tasks
  • Benchmark development and repositories
  • Longitudinal case studies
  • Adoption

Format of the event (1 full day)

Ideally, about 20 participants will attend the workshop. During the workshop accepted papers will be presented, leaving large space for questions and discussions. The last two hours of the workshop will be reserved for discussion of hot topics, issues, and open problems. The workshop website will serve as an archive of the ideas raised during presentation and discussion and will be further refined afterwards to create a permanent resource for people who are interested in the matter. A shared space will be provided in which authors and potential participants can add links, comments, and suggestions, before and after the workshop.

Important Dates

Deadline for submissions: Mar 19, 2006
Notification of acceptance: Apr 12, 2006
Early registration deadline: Apr 15, 2006
Camera ready papers due: Apr 24, 2006
Workshop: May 23, 2006

How to participate

We solicit position and research papers up to 6 pages (less is fine). All the submissions should be formatted according to the guidelines used for the papers of the main conference. Suitable templates can be downloaded from: Submission should be either in PDF (preferred) or Word format and uploaded to the review system accessible from the following url: For any questions contact Enrico Bertini at:

Accepted papers will be revised after the workshop and published in the ACM Digital Library.

Workshop Organizers

Enrico Bertini, Dip. di Informatica e Sistemistica, University of Rome “La Sapienza”

Catherine Plaisant, HCIL/UMIACS, University of Maryland

Giuseppe Santucci, Dip. di Informatica e Sistemistica, University of Rome “La Sapienza”

Program Committee

Alan Blackwell (Cambridge University, UK)
Margaret Burnett (Oregon State University, USA)
Tiziana Catarci (University of Rome, Italy)
Chaomei Chen (Drexel University, USA)
Luca Chittaro (University of Udine, Italy)
Maria Francesca Costabile (University of Bari, Italy)
Mary Czerwinski (Microsoft Research, USA)
Alan Dix (University of Lancaster, UK)
Jean Daniel Fekete (INRIA, France)
George Grinstein (UMass, USA)
Stephen Kimani (University of Rome, Italy)
Chris North (Virginia Polytechnic Institute, USA)
George Robertson (Microsoft Research, USA)
Ben Shneiderman (Maryland University, USA)
John Stasko (Georgia Tech, USA)


We have prepared a list of papers about evaluation for infovis. This may be useful as reference to workshop participants and people interested in the topic.

eXTReMe Tracker