AMBOSS Educator Tool: Accessing data & analytics

Use the data and analytics functionality of the AMBOSS Educator Tool to gain meaningful insights into how your learners are engaging with content, performing on assignments, and using the AMBOSS platform. Customize your data and analytics dashboard to see how your learners are performing across medical disciplines and assess their readiness for upcoming examinations. Use the metrics to create customized, data-driven study plans for your learners.

• Access the Data & Analytics homepage through “Data & analytics” in the left-hand menu.
• Inviting a learner sends them an email invitation; they must confirm to be added to the dashboard.
• Educators can review learner performance across assignments and for individual questions.
• Customize dashboard to meet your needs.
• If the dashboard times out (e.g., after 15 mintues of inactivity):
  • Refresh AMBOSS page.
  • Click back into dashboards.
• Export any table as a CSV, Excel, JavaScript file, or image by clicking the 3-dot menu in the top-right corner and selecting “Download full results.”

Learners will only appear in the Data & analytics dashboard after they have accepted the invitation and activated their account.

The assignment insights dashboard provides information about how learners are engaging with assignments.

Access to the assignment insights dashboard

• Educators can see data related to:
  • Assignments they have created.
  • Assignments that list them as a collaborator.
  • Assignments that include them in the learner group.
• Admins: See data for all institutional groups and users.

Filter the assignment insights dashboard

The assignment dashboard can be filtered by:

• Date ranges
• Specific assignments
• Institution group
• Cohort
• Individuals
• Bundles
• Archived assignment data (e.g., completion rates, percentage of correct answers, time spent per question, overall engagement trends)

Available metrics

• Individual learner metrics: Educators can view individual level data only if they also belong to the learner group, even for assignments they created.
  • Qs completed: number of questions completed out of the total assigned
  • % Qs completed: completion percentage
  • % Correct of assigned: based on all assigned questions (even if unanswered)
  • % Correct of answered: based only on questions the learner answered
  • Initial %: % correct based on the response from the learner's first interaction with a question
  • Final %: % correct based on the response from the learner's latest interaction with a question
  • Articles read: number of assigned articles read
  • Last active: most recent activity date
  • Time per question (in seconds): average time spect per question

Make sure educators are included in the group of learners for the assignment in order to view individual learner metrics.

• Assignments report card: Displays learner performance across multiple assignments
  • Columns = each assignment; rows = individual learners
  • Shows % correct for each learner for the selected assignments.
    • 0%: assigned but no questions answered
    • – (dash): assignment not assigned to the user
  • Can be exported into LMS, and/or downloaded (e.g., pdf, xls, cvs).
• Individual question breakdown: Identifies gaps in learning by displaying learner performance for each question.
  • Performance by question: Identifies which questions learners get right or wrong.
  • Questions by exam: Filter by exam type (e.g., USMLE, Shelf exam) to assess exam readiness of the group.
  • Questions by system: Assess how learners are performing by organ system to plan targeted teaching.
  • Questions by discipline: Track learner progress by medical discipline (e.g., internal medicine, surgery) to guide teaching priorities.
  • Questions by competency: Analyze data by clinical competency to monitor skill development across your cohort or group.
  • Personalized study recommendations
    • Automatically generated based on performance and study goals.
    • Filter by exam, cohort, group, or individual.
    • Supports remediation and study plan development.

Flexibility and custom dashboards

• Dashboard links are shareable, but only to those with the access credentials to view them.
• Dashboards can be customized to fit different learner types, specialties, and cohorts.
• Track cohort progress using custom groups (e.g., PGY-1, Senior year)
• Customize for your institution, cohort, class, or specific learners.
• Metrics that are not relevant for you can be adjusted and/or hidden.