Joe,
I agree. An integrated approach works for many different things. Kirkpatrick does include the following (if we're talking about the same Kirkpatrick) but I find four steps.
â—¦Step 1: Reaction - How well did the learners like the learning process?
â—¦Step 2: Learning - What did they learn? (the extent to which the learners gain knowledge and skills)
â—¦Step 3: Behavior - (What changes in job performance resulted from the learning process? (capability to perform the newly learned skills while on the job)
â—¦Step 4: Results - What are the tangible results of the learning process in terms of reduced cost, improved quality, increased production, efficiency, etc.?
It's great to have a plan that all instructors follow or all programs or however your college may be set up. Thanks agian.
An integrated approach provides the most comprehensive feedback for closing the loop. We use Kirkpatrick’s five levels of evaluation integrated with an ongoing curriculum review process. Our curriculum review integrates the feedback and assessments from the course with an Instructional Design Process (ISD) and a Curriculum review committee. After each course all five levels of evaluation are compiled by our institutional effectiveness section. The Instructor works with the Curriculum designers to look for trends or inconsistencies in the instruction. The ISD process is an ongoing process that results in an annual curriculum review by out Curriculum Review Committee. Additionally every 5 years we do a zero based requirement review to see if the course is still required. No one method achieves the results we need to maintain our level of excellence in the curriculum.
Sandi,
Your are right. Each will provide different, but important feedback. Thanks!
Joel,
You're right. There are various ways to get feedback and the more ways you get the feedback, the more comprehensive. Everybody looks at things differently and the opinions of others is great feedback. Thanks!
I think peer feedback and direct student feedback are keys. Both provide objective perspectives that help with revisions and adjustments.
I believe a combination of student grades and student evaluations provide the most comprehensive feedback. Although it is beneficial for other entities to evaluate the course, courses are created for one audience essentially, students, so their feedback should have a little more weight. Let's not forget online students are often non-traditional and have a variety of experiences so they are a good cross-section of input.
Richard,
Correct. The more others view our course or assignments and give us feedback, the better. Thanks!
We all do make errors, and many times, it is difficult for us to see our own errors. The additional sets of eyes are hugely important.
Robert,
Yes, feedback from students provide great insight. I learned a lot about the student point of view when I took an online course. You certainly learn what to do and what not to do in that way. Keep asking your students for input and continue the revision process. Thanks!
Renee,
Student feedback is so important. I certainly don't take anything personal. . .I just look at it as a way to continue to improve the course. Thanks for your input.
The response from the end users (students) is always a great resource. However within the confines of the classroom student attitude about the class must be taken into account as all students are not necessarily objective in their expressions of assessment. You must have their input but add to that review by the instructor peer group to allow for a reasonable and useful evaluation.
Student feedback throughout the course should be remembered; various sections of a course can contain directions that are confusing or incorrect answers to questions (to name a few that happen!) and as instructors these issues can create solutions that take up a ton of time and could have been avoided if addressed after the completion of the previous course. The students also take on a level of ownership and their input ( sometimes taken as a complaint ) is valuable and they need to be told that.
I think 2 areas but the same feedback mechanism.
Look at the open ended questions and commented submitted by the Students and Faculty.
Someone can rate the course 10 out of 10 or 1 out of 10, it is that 1 out of 10 I would be most concerned with. Why did they rate it like that. So the open ended feedback allows survey responders to explain the ranking given.
Without it we are left to only wonder what is wrong.
Ginny,
Oh, I like the letter part to the future students. That's cool. I use Stop, Start, and Continue about twice a semester. What do you want me to stop doing, start doing, and continue to do? I always get good feedback as I do it anonymously. Good ideas. Keep them flowing.
Dr. Tena B. Crews
Hi Dr. Crews,
By utilizing several methods of evaluation, we have a broader perspective on what works and what doesn't. The student survey is always popular. In Graduate School, they utilized this method of course evaluation. If you liked the course and/or the instructor, the sequence was A-A-D-D-D-A-A-A-D-D-A-D. If you didn't like the course and/or the instructor it was D-D-A-A-A-D-D-D-A-A-D-A. As an instructor, I can see where this method of evaluating is not very helpful and definitely doesn't provide any useful feedback.
In a couple of the classes I teach, the students are required to keep a journal to record their thoughts and/or experiences in various activities and assignments. As part of the final, I ask them to write a letter to a future student about what they liked and didn't like about the course, lectures, assignments and activities. The grading for this assignment is based only on completion or non-completion. I have found that by doing this, the students are much more comfortable providing honest feedback.
Thanks,
Ginny
Margaret,
Getting feedback in various ways is helpful. The structured interviews can be helpful and, you're right, get to the real issues, but sometimes they are difficult to set up. But, it's worth a try. Thanks!
Laura,
Getting feedback from peers and students provides different viewpoints. I like to get a feel for what they think about the course so that I can improve it for the next semester. Thanks for your input.
William, that all sounds very logical to me. Realizing that we all make errors is so important.
The types of evaluation that I think would be most effective are: Question tools to spot check student learning, exminations,peer review, and structured interviews. I really like the idea of structured interviews because I think you could get to the real issues with more time and feedback from users.
Of all of the methods, I feel that evaluation by another instructor can give the best results. The reason is they are aware of the course, difficulties and challenges and can relate to the instructor.
