objects/scientific-evaluation.html

Scientific Evaluation

Preview to scientific evaluation

Adress how to make scientific decisions that include:

uncertainty

varying levels of control (see the chart at the beginning of lecture)

range of held and considered values

held - not likely to change

consider changing values with new information

The scientific approach requires:

objective statements that are independently verifiable

rigorous and transparent methodologies

discover new knowledge, not just judgement

Key problem

how do we treat values objectively?

preview - objective, testable statements about values and range of considered values

Criteria and process for evaluation

The following criteria are useful guides for evaluating the progress on addressing a wicked problem.

General Criteria Example key questions

Value statement Is the value proposition clear enough to the entire community?

Background and introductory information Are the narratives broad enough and from diverse viewpoints or do they look artifically constrained or pointing to some predetermined outcome (Goldilocks Scenarios)?

Goals Are these stated clearly and do they bring in issues that engage a broad range of stakeholders?

Objectives Are these stated as hypotheses for management?

Technical specifications Were the technical objectives met?

Budget Was the project financially sound?

New knowledge What was the new knowledge that was created? Was it useful? Was it used? Did the community learn? Were new areas of knowledge identified as needs?

Adaptation Did the overall project demonstrate that it was able to adapt to new knowledge or uncertainty?

Sustainability Was the capacity to create ongoing management created and functioning?

General Criteria	Example key questions
Value statement	Is the value proposition clear enough to the entire community?
Background and introductory information	Are the narratives broad enough and from diverse viewpoints or do they look artifically constrained or pointing to some predetermined outcome (Goldilocks Scenarios)?
Goals	Are these stated clearly and do they bring in issues that engage a broad range of stakeholders?
Objectives	Are these stated as hypotheses for management?
Technical specifications	Were the technical objectives met?
Budget	Was the project financially sound?
New knowledge	What was the new knowledge that was created? Was it useful? Was it used? Did the community learn? Were new areas of knowledge identified as needs?
Adaptation	Did the overall project demonstrate that it was able to adapt to new knowledge or uncertainty?
Sustainability	Was the capacity to create ongoing management created and functioning?