Automated feedback coach 2.0

What is Automated Feedback Coach 2.0? How is it different from the previous version?

Automated Feedback Coach 2.0 uses advanced Large Language Models provided by Azure OpenAI Service to process students’ input and provide feedback.

We choose to use Azure’s OpenAI Service to deliver this feature because of its enterprise-level security, compliance, and regional availability.

Compared to its predecessor, it is much faster, more scalable, and can provide more specific and actionable feedback based on the context of reviews, such as the feedback criteria.

How can I enable this feature in a Peer Review or Group Member Evaluation activity as a teacher?

In the Given reviews module, navigate to Guiding students, section. Enable the feature by toggling on the option for "Automated feedback coach."

What does the Automated feedback coach look like when it's working?

After the teacher has enabled the Automated feedback coach feature for a Peer Review or Group Member Evaluation activity, students enrolled in that activity will see "Automated feedback coach" in their feedback giving window when they begin to write reviews for other students.

Once the student starts typing their reviews, the AI coach will process the content and gives feedback to the student. The feedback updates in real time as the student adds on or alters their reviews. Please see the image below for an animated presentation of the functionality.

Can I choose to not use this feature as a student, even if my teacher has enabled it for me?

Yes, you can disable or enable it any time in your FeedbackFruits preferences.

What is included in your prompt?

A prompt is a set of specific instructions given to a large language model to generate a particular type of response or follow a specified task. Prompts help prime the AI model to know what and how it should respond. Examples of prompts include “Write me a short story about turtles and rabbits”, “Explain the moon landing to me as if I were 10 years old”, or “Help me translate my feedback into Dutch.”

Because prompts contain cues or guidelines that help create a feature, they can also be considered intellectual property. Although we cannot divulge the exact prompt, here are some of the elements included in the prompt for the Automated Feedback Coach 2.0:

• Respond in a helpful and coachable way.

• Ensure that the feedback addresses the given criteria.

• Include the feedback and context (such as the criteria) in a specific format.

• Compliment and encourage students to give better feedback.

• Do not respond to gibberish, random text, or things that appear unrelated to giving feedback to a peer.

• Offer areas of improvement.