Use case 4: Post-session feedback report

Description:

After a simulated training session in the AI training room or a client session, a trainee or care provider receives a report with meaningful insights, suggestions for additional modules, and the option to request an expert review from their task-sharing supervisor.

Example scenario:

After completing a simulated training session, a trainee or a care provider receives an AI-generated post-session feedback report detailing their performance. The report includes scores on meaningful competencies, such as empathy; adherence to therapeutic models, and listening skills. Additionally, it provides qualitative insights that will point out exactly where adherence veered from the expectation and exactly which part of delivery showed a deviation and did not meet the standard. For example, “Your empathy was high today, making your client feel at ease. However, adherence to the model was below expectations. Consider trying a different approach next time.” The report also recommends specific training modules that trainees should review again to strengthen underdeveloped skills. The trainee or care provider can then choose to request to have a supervisor review their feedback and provide further guidance. This structured feedback empowers trainees to continuously improve their skills through actionable insights and targeted recommendations.

Opportunities unlocked:

The post-session feedback report could address several challenges in mental health task sharing programs, including the following:

• Supervisor shortage, limited time, and resource constraints. Many training programs face a shortage of qualified supervisors with limited time and resources, which may result in delayed or infrequent feedback for trainees. The post-session feedback report could fill this gap by automatically generating performance evaluations immediately after each session, enabling timely feedback and maintaining training momentum without having to wait for human supervisors. Additionally, by streamlining the feedback process, the post-session feedback report allows supervisors to dedicate more time to trainees who require deeper guidance and support.
• Protocol drift. The post-session feedback report could also help maintain fidelity during the task-sharing program or after the trainee has graduated from the program. It could highlight meaningful phrases or steps to confirm that trainees or care providers are adhering to intervention protocols and indicate if there is a drop in a provider’s fidelity score. Supervisors can then intervene, if necessary.
• Inconsistent feedback and observer bias. When supervisors are available, their feedback can vary substantially depending on their focus areas. For example, some supervisors may emphasize technique-specific competencies, while others may focus on foundational helping skills. The post-session feedback report could standardize evaluations by consistently assessing meaningful competencies across both of these focuses, such as empathy, technique adherence, and listening skills. It could offer balanced feedback across all critical areas, ensuring comprehensive skill development and reducing subjective biases.

How could the end user(s) benefit from this use case?

The primary end user who could directly benefit from this solution is:

• Care provider. Trainees or care providers could benefit from the post-session feedback report by using the actionable insights they receive on their strengths and areas of development to refine their foundational helping and technical skills.