Jessica,
This is a great idea. Sometimes, off task is a momentary thing, and students just need a bit of urging to get them back on track. In these instances, I begin to circulate around the room, stand next to distracted students, ask specific students specific questions, or perhaps have them write key words on the board as I'm discussing a topic. I suppose there are dozens of variations of the same ideas.
Barry Westling