An important step in the assessment process is choosing an appropriate method for collecting data. When considering how to assess your goals or outcomes, it can be helpful to start by thinking about answers to the following questions:
- What type of data do you need?
- Has someone already collected the information you are looking to gather?
- Can you access the existing data?
- Can you use the existing data?
- Is there potential for collaboration with another individual, program, or department?
- How can you best collect this data?
- How will you specifically use the information you collect?
Direct and Indirect Methods of Assessment
There are many assessment methods to consider, and they tend to fall into one of two categories: direct and indirect methods. When assessing student learning in particular, direct methods are often needed in order to accurately determine if students are achieving the outcome.
- Direct Method - Any process employed to gather data which requires participants to demonstrate their knowledge, behavior, or thought processes.
- Indirect Method - Any process employed to gather data which asks participants to reflect upon their knowledge, behaviors, or thought processes.
Direct Evidence of Student Learning
Sources of direct evidence of student learning consist of two primary categories: observation and artifact/document analysis. The former involves the student being present, whereas the latter is a product of student work and does not require the student to be present. Here are some examples of each:
- Observation opportunities: performances, presentations, debates, group discussions.
- Artifact/document analysis opportunities: portfolios, research papers, exams/tests/quizzes, standardized tests of knowledge, reflection papers, lab reports, discussion board threads, art projects, conference posters.
Indirect Evidence of Student Learning
In addition to the sources of direct evidence, there are also other types of data that indirectly provide evidence of student learning. While data of this nature can be useful, it is important to note that direct evidence is needed to fully assess student learning outcomes.
Examples of indirect assessments include:
- Student participation rates
- Student, alumni, and employer satisfaction with learning
- Student and alumni perceptions of learning
- Retention and graduation rates
- Job placement rates of graduates
- Graduate school acceptance rates
Once methods have been discussed, it can be helpful (and ensure timeliness) to think about the assessment implementation plan for each method:
- What: What specific data do we need to collect?
- Who: Who is responsible for implementing the assessment?
- Whom: From whom are we collecting this data?
- When: When are we collecting this data? (i.e., What is the timeline for data collection?)
- How: How will we collect this data (i.e., What resources will be used to collect the data?)
- Why: Why are we collecting this data (i.e., What do we plan to do with it?
The answers to these questions are often discussed as part of the assessment planning process and may be included in assessment plan documents.