Read the Insights page

Read how well the AI models do, in 5 panels. You can export the figures as a CSV file for a paper.

Before you start

• You need the admin role.
• The panels fill only when people accept or reject AI suggestions. Until then they read "No AI suggestions yet".
• The figures cover the whole site, not one project.

Steps

1. Open the Admin area. The Project Status page opens.
2. Click Insights in the bar on the left. The heading reads "Platform Insights", above 3 cards: AI Suggestions, Reviewed and Overall Accuracy.
3. Click Export metrics (CSV). Your browser saves 1 file with every panel in it.

The numbers load again each time you open the page.

The 5 panels

• Per-model accuracy: 1 row per model, with total, pending, accepted, rejected and modified counts. A bar shows the share accepted.
• Confusion matrix: the label the AI gave, against the label a person put in its place. Green on the diagonal means agreement.
• Confidence distribution: bars, grouped by how sure the model was. Green is accepted, amber is modified, red is rejected.
• Human vs AI agreement over time: a line. It shows the share accepted with no change, day by day.
• Most frequent corrections: the label changes people make most often.

Read them together

A high accuracy with few reviews means little. Read Reviewed first. Then look for a red square off the diagonal in the matrix: that pair is where the model is wrong in a steady way.

Check it worked

The saved file opens in Excel. It starts with the line "GRAPE MARS — AI Model Insights".

If something goes wrong

• The admin pages say I am not allowed
• AI analysis failed
• Request failed

Related

• Manage AI models
• AI features available today
• Admin