Meeting with Luigina Ciolfi - Aug 22nd (Evaluation)

Today we met with Luigina to sponge off her excellent skills and knowledge in evaluation techniques.

During the course of study, we were mainly focused on evaluating systems with user interfaces, usually GUI's. We knew that the same sort of techniques would not necessarily apply to our project. Before speakimg to Lui we were looking at undertaking a heuristic evaluation (evaluating the prototype with a number of chosen experts, based on set design principle criteria).

Lui advised that Heuristic Evaluation applies essentially to user interfaces, and that our instrument prototype bares no relationship to the type of criteria involved.
As our project is very much exploratory, it would be best to take a loose informal approach. The following approach suggested by Lui would be best:

*Choose 5 to 6 test subjects, that fit our various user profiles.
*Conduct an informal walkthrough of the prototype, showing it's various functionalities.
*Prepare a number of questions that search for what we need to find out. i.e. How do you feel these functions are an improvement on existing instruments?
*Maintain an informal discussion, dropping subtle hints that keep the feedback on course.
*Don't dwell on information that not important for what we need to know.
*Document techniques, notetaking, dictaphone, video.
*Stay away from questionnaires!

Lui advised that this can be conducted after aug 24th if prototype isn't ready.
She recommended however, that we document, what, why, who and how we want to evaluate.

Thanks Lui