How do we know what works?
Through my limited experience, I have found the most effective way to evaluate the effectiveness of a course, or an entire program for that matter, is to evaluate the quality of the graduate. This means that the course or program must first run its length, then the graduating student must be evaluated on their ability to meet the demands that are placed upon them once in the field. For example, the only way to know what the best way to build a car is would be to build the car, test it, evaluate the car's performance stated criteria, then build another car!
David,
This is true that it does take time to know what you know, the experience gaining this knowledge is a journey all in itself.
Shelly Crider
In the example ( building a car), I can relate to how that would be a valid way of assesing the student. Of course, if the Student was asked to build a NASCAR vehicle, and instead built a Dune Buggy, one would have second thoughts.
In a discipline such as Crminal Justice ( my field), it will be YEARS if / when / untill a Student will actually 'test" a lot of what he / she has learned. A better way of looking at "success" here might be much more incrimental such as being able to graduate from a Police Academy, passing in-service training requirments, or even learning what doughnut to eat with coffee .
I think that ongoing evalutions may help a little better than one big evaluation at the end. This way you can focus on each part of the course and make the necessary changes as you go along. Therefore each area of the course is attended to.
I agree that any course can be evaluated partly based on the quality of the graduate. I also think a course can be evaluated based on instructor review, student questionnaires, and grading outcomes at the end of the course.
Most importantly, courses must continue to change and adapt to avoid stagnation especially in an online setting where assignments can be shared.
Will,
I agree the whole purpose of our job is to create graduates that have learned something. They need to be able to think and solve problems. The effectiveness of a course is tied to the effectiveness of a student.
Walter
Walter van Poollen
10-10-12