I believe that the assessment needs to be clear and concise, so the objective of the assessment is understood by all types of students. Also, grading and feedback by the instructor should be done in a timely manner so that the student knows and understands exactly what the objective was/is for the assessment. Third, the assessment should be different assessment to assessment to have a variety of learning experiences.
The three most important things to consider when assessing the use of technology assessment tools is the ease of understanding and implementation by both the student and the instructor and if it supports the objective of the overall course.
Steve,
Great points! It does concern me that students think they can take an online course with out appropriate devices. You want students to be familiar with the technology as you want the assessment to assess their learning not how well they use the technology.
Dr. Kelly Wilkinson
First I would ensure the student has the proper device, laptop to interact with the technology assessment tool. Next, consider what type of technology tool is most ideal for the student based on the subject matter. Finally making certain that the instructor fully understands the use of the technology tool on his/her end for the benefit of student success.
Robert,
Great post! Yes, you want to make sure that your students can work the software as you want to measure what they learn not how well they learn to use the software. I agree, you want to make sure that you can extract the data and provide feedback that both you and your students need.
Dr. Kelly Wilkinson
The first thing to consider is whether the student(s) can use the technology. The instructor needs to make sure that whatever technology is chosen, it won't complicate the student's ability to receive and understand the message. This can be achieved with student feedback throughout the course, and at the end of a course. If there's an issue, it would certainly skew any results gained from the use of the technology.
The second consideration is whether the technology
is "student friendly." Again, feedback is essential in making a determination whether whatever the student is being asked to use, is easily accessible, and understandable.
The third, and perhaps this should be the first, is that the instructor understand the use of the technology. Or, whether another type might be adapted for his/her use online.
Kimberly,
You have a complicated situation. You want to be supportive and understanding but students know they have to have technology to complete the course. It is a difficult balance. I become frustrated when the I am the blame because the student did complete a course successfully because they only had internet for one week. In a f2f course I would never tolerate that type of action.
Dr. Kelly Wilkinson
Twyla ,
You are right. You don't want the students to have so much anxiety over the technology that it taints the assessment (and that happens). When a student isn't comfortable with ANY TYPE of technology the anxiety level regarding assessment can explode! I give my students practice tests to take online so they get used to the technology as well as study for the content.
Dr. Kelly Wilkinson
Hi Dr. Wilkinson,
With the student demographic that we have attending our school, computer and internet usage is a major problem. When enrolling in an online program, it is mandatory that you have both but from one week the next, a student might communicate that their computer is not working (virus) or their internet was disconnected. In saying this, I believe it is important that the student has the tools required to access the type of assessment chosen.
Are the students able to use the assessment tools? If the students are experiencing challenges, you might wonder if their work or scores are accurate. Did they become frustrated and didn’t do their best
It is important that the instructor is knowledgeable in using the assessment tools. If the instructor does not use the tools effectively then it would be hard to monitor student’s success or determine where additional help/learning is needed.
Jacquilin,
These are great points, would also add the quality of output? I have had issues with this lately.
Dr. Kelly Wilkinson
Hi Dr. Wilkinson,
I think the three most important things to consider when assessing the use of technology assessment tools in an online learning environment are:
1. Can the student easily navigate the technology tool
2. Is the instructor knowledgeable enough to assist the student with using the assessment tool
3. Is the tool set up to effectively perform as designed or desired
I have found that number 1 is the most important because there are so many students who are returning to school after many years who have never used the computer. It takes a lot of time away from focusing on the coursework when the instructor has to teach navigation of the system at every assignment.
Twyla
Relevance, ease of understanding, accurately measurement
Robert,
Great post. You don't want the technology to be a barrier to student success. Students need to be able to use the technology effectively.
Dr. Kelly Wilkinson
I believe the most important is whether the tool improved I2S communication. Since f2f is rare in this environment, any type of tool must not only help in this area, but also conversely in S2I communication. The third most important would be
whether the student had any issues in using the tool. Whether expectations were made transparent, along with a "how to" guide on how to use the tool.
Cally,
You are wise to ask if the technology is working for the students. That makes so much sense. I also track students access and usage of the technology through my LMS. I find that very handy.
Dr. Kelly Wilkinson
I like to consider what is in it for me, what is in it for my students, and the difficulty of implementation. I like to use the options that have had a positive impact in the past and then consider adding other elements. The classes that I teach are visually rich, and it is easy to look at images, so I have added video, audio, and online games to complement to education experience. These do not replace, but augment and suggest dimension and integrate texture. I also ask my students if what I am doing “works†for them or if it is too time consuming or not valuable—they are good at assessing their needs too. Finally, if the technology is complicated to use, requires additional hardware, or is replaces a functional aspect, I sometimes question its productivity. I am always looking to add technology that is not just visually-based.
Eman,
Great observation. Yes, you should not have to completely revamp your assessment for the technology, the technology should adapt to the assessment. Also, you need to be able to get the data you need for assessment of your students and your teaching.
Dr. Kelly Wilkinson
Hello Kelly and everyone,
The first thing to consider is how the assessment tool is effective and if any changes are needed to enhance the assessment process. Also, the students' feedback is important to be considered so that any changes to the assessment methods can be applied before using it another time the course is taught. Moreover, the instructor needs to judge the technology assessment tool himself/herself to decide if the tool assists him/her in providing meaningful feedback.
Carole,
What a great post. Assessment is not easy and can be complex. You want it to be meaningful toward individual student learning and to use it as an analytic for the course. Consideration of purpose and outcome must be thoroughly reviewed.
Dr. Kelly Wilkinson
Bruce,
Wow, a great list. All are so important for success online. Do you have strategies to deal with these?
Dr. Kelly Wilkinson
