Design Considerations
Requirements Gathering
Envisionment Methods
Evaluation
Other
Users of this site also found these sites useful
Evaluation Methods
What is Evaluation?
Evaluation should have a context
- What do you want to evaluate and why?
- When and how do you do evaluation ?
- Evaluation is often concerned with the usability of the application
or system
Why Evaluate?
- To try to maximise harmony of PACT elements.
- Is the design good enough?
- To compare different designs
- To test conformance to standards or to agreed measures
- To involve people in design
- To design iteratively because 'designers, no matter how good they are
cannot get it right the first few times'
Evaluation can be:
- Free-form or task-based
- User-based or expert-based
- Structured or unstructured
Factors Affecting Validity
- Evaluation Method
- Suitability of Method
- Test Environment
- Completeness of prototype
- Users
- Previous experience
- Motivation and interest
- Sample size
- Evaluators
- How experience?
- Are they biased?
Ethical considerations in testing and evaluation
- Be informative
- Be reassuring
- Be considerate
- Respect privacy
The DECIDE framework can be used to structure your evaluation
- Determine the overall goals that the evaluation addresses
- Explore the specific questions to be answered
- Choose the evaluation paradigm and techniques to answer
the questions
- Identify practical issues that must be addressed,
such as selecting participants
- Decide how to deal with ethical issues
- Evaluate, interpret and present the data
Examples
Examples of Evaluating Systems
- paper prototyping
- Participatory Heuristic
Evaluation
- Thinking Aloud Protocol
- Co-discovery Learning / Constructive
Interaction
- Retrospective Testing
- Performance Measurement
- Question Asking Protocol
- Remote Testing
- Pluralistic Walkthrough
- Cognitive Walkthrough