Course list.Learning analytics.Switch views with the Progress and Stumble analysis tabs at the top of the screen. Filter users, Anonymize students, and Display class are shared by both tabs. Users who can review students' conversations also see an AI chat tab, where you can list the conversations for that course (Review AI chat conversations). The selected tab and class are included in the URL, so you can share or bookmark it as is.
To check where students stumbled in a specific class, select the Stumble analysis tab and choose the target class in Display class. Stumble analysis is performed per class, so All classes cannot be selected in Display class on the Stumble analysis tab. If you open the Stumble analysis tab while All classes is selected, the screen automatically selects the class that contains the most recent question among the questions from learners within the scope of Filter users (if there are no questions, it selects the first class). The selected class carries over even when you return to the Progress tab, where you can reselect All classes.
Struggling membersAuto-refresh, the data is re-fetched automatically about once a minute even while the screen stays open. The setting is saved in the browser and carried over the next time as well.For each learner, the following columns are displayed for the last coding problem they opened.
| Column | Content |
|---|---|
| Last opened problem | The problem the learner last opened |
| Last activity | Learning (within 5 minutes of the last operation), or the elapsed time since the last operation |
| Status | Whether the learner has ever answered that problem correctly (Correct, Incorrect, Not submitted). Once correct, it stays Correct even if they submit an incorrect answer afterward |
| Total time on page | The total time spent with the problem open |
| Hint count | The number of times additional hints were generated for that problem. Includes hints automatically generated on incorrect submissions, but does not include estimates of error locations |
| Submission count | The number of submissions to that problem. Clicking it opens the submission list filtered to that learner and problem |
When you open submission details from the submission list, you can check the content of the hint the learner last viewed and the viewing time, shown as Last viewed hint information.
The speech bubble in the "AI chat" column indicates that the learner has a history of asking questions to the AI in that course. Chats started from any screen of the course, material, or problem are included.
If the last question was within 5 minutes, the bubble is shown filled in green; otherwise it is shown as an outline-only gray bubble.
Next to the bubble, the number of today's conversations is shown. If there are only past conversations, no count is displayed.
No bubble is shown for learners who have never had a conversation history.
Click the bubble to review today's conversations, sorted by the most recent question time in descending order. If there are no questions today, a message to that effect is shown. While a summary is being generated or if it cannot be retrieved, "AI question" is displayed.
Click a question summary to review the questions and the AI's answers in that conversation.
Click "View past conversations" to open the AI chat tab filtered to that learner.
Hover over the information icon in the "AI chat" heading or over the bubble to check the display rules and the current state.
Question history is retrieved at the same timing as the existing learning analytics. This applies to "Refresh data," auto-refresh, changing the filter conditions, and returning to the browser tab after the retrieved data has become stale.
There is no toggling of the chat panel, tab display state, or display switching due to connection loss. Chats that have not had any questions are not displayed.
If questions in the last 15 minutes include "requests for answers or code," the bubble shows Answer request with a count next to it. If there are no "requests for answers or code" but there are "errors/debugging" questions, it shows Error consultation. The intent of each question is automatically classified by AI.
The targets displayed are the chats in which students of the selected organization or group asked questions in this course. Counts and the list in the bubble cover only today's conversations and show only the conversations you have permission to view.
Displays learners who may need outreach, along with the following reasons. Administrators are not displayed. If a learner has multiple reasons, they are combined into one row and the basis is shown under Status.
The table has the same columns as the list of all learners (last opened problem, last activity, AI chat, status, total time on page, hint count, submission count, progress per displayed class), plus Reason and Status columns. There is no sorting and no statistics row.
Sort order: learners with more reasons come first; when reason counts are equal, learners with a longer total time on the last opened problem come first. Learners whose only reason is Not started are shown last. Up to 10 unhandled learners are shown, and learners marked as handled are shown after them.
| Reason | Condition for display |
|---|---|
| Prolonged stagnation | The last opened problem is not yet correct and there has been an operation within 5 minutes (regardless of whether they asked the AI). Status shows the total time on that problem and the number of AI questions in the last 5 minutes |
| Repeated same error | From the latest submissions in the last 15 minutes, there are 3 or more consecutive incorrect answers to the same problem (with no subsequent correct answer or submission to another problem) |
| Requesting answers | There are 3 or more questions requesting answers or code in the last 15 minutes |
| Not started | The learner has neither viewed nor submitted any problems in the displayed classes (since they may be absent, they are shown after learners with other reasons) |
Checking the box at the start of a row displays it faintly at the end of the list as handled. The check is saved in the browser and is cleared when the date changes. If a new reason appears after checking, the check is cleared and the row returns to the prominent display.
This screen is for reviewing, after class, what learners stumbled on in AI chat. When you select one class in Display class, it displays questions asked in that class's materials from learners within the scope of Filter users.
Analyze makes the AI group the questions by topic. Analysis results are generated in the display language of the screen and are saved per class, filter condition, and display language, and remain displayed next time. Analysis covers up to 500 questions, from newest to oldest; older questions are not analyzed. Questions added after analysis are shown as Not analyzed with a count, so press Re-analyze as needed. If, after analysis, the target learners fall outside the filter scope or conversations are deleted, the previous result is not shown and re-analysis is prompted.Frequently asked topics shows up to 10 topics asked by 2 or more learners. Topics asked by only one person are grouped as Other (one person each). Pressing the Learners or Questions heading sorts by that column. Initially it is sorted by learner count descending; pressing the same heading again reverses the order. In either order, the top 10 topics by count are displayed, and Other (one person each) is always shown last. The Question intent band shows the breakdown of question intents within a topic by color length; the color-to-intent correspondence is shown next to the table heading. Hovering over each color in the band shows its intent and count. Pressing a topic shows what was unclear, hints for the material (estimated by AI), and the learner's statements and question intents. Open conversation opens the details of the relevant conversation (Review AI chat conversations). For conversations you cannot open due to conversation view permissions (such as when the managed group or organization is not linked to the course), Open conversation is not displayed.Download CSV saves the Frequently asked topics table as stumble-analysis.csv in the same order as the screen. Columns are topic, learners, questions, what was unclear, hints for the material, and material; Other (one person each) is also included as one row. Learner statements, names, and email addresses are not included. It cannot be pressed when no analysis result is displayed.Material column of Frequently asked topics opens Improve material on that material's edit screen.By learner includes learners who have not used the chat, displaying question count, number of answer/code requests, number of submissions, number of correct answers, and last question. Initially sorted by question count descending; pressing the Questions, of which answer requests, or Correct headings sorts by that column (Correct ascending). Pressing the same heading again reverses the order. Pressing a learner shows the questions and submission history for that class in chronological order.Anonymize students is enabled, learners are shown by number.If class hours are set, each cell can distinguish whether the submission was made during class hours or outside class hours.
This lets you distinguish, at a glance, submissions made during class from those made as self-study or homework. If class hours are not set, all submissions are displayed filled.
Filter users can be switched at both the organization level and the group level.Download CSV, you can select columns such as profile items like affiliation and student ID, submission date and time, score, whether it is an excellent submission, source code, and options such as calculating the average and standard deviation. The target is the range selected in Filter users and Display class, and administrators are not included. Anonymize students is not reflected in the CSV.