Course list.Learning analytics.Switch between the displays with the Progress and Stumble analysis tabs at the top of the screen. Filter users, Anonymize students, and Display class are shared by both tabs. People who can view students' conversations also see the AI chat tab, where they can list the conversations for that course (Check AI chat conversations). The selected tab and class are included in the URL, so you can share it or bookmark it as is.
To check where students stumbled in a specific class, select the Stumble analysis tab and choose the target class under Display class. Because stumble analysis is performed per class, All classes cannot be selected under Display class on the Stumble analysis tab. If you open the Stumble analysis tab while All classes is selected, the class that contains the most recent question among the learners' questions within the scope of Filter users is selected automatically (if there are no questions, the first class is selected). The selected class carries over even when you return to the Progress tab, where you can reselect All classes.
Struggling membersAuto refresh automatically re-fetches data about once a minute, even while the screen stays open. The setting is saved in the browser and carried over the next time as well.For each learner, the following columns are displayed for the coding problem they last opened.
| Column | Content |
|---|---|
| Last opened problem | The problem the learner last opened |
| Last activity | Studying (within 5 minutes of the last operation), or the time elapsed since the last operation |
| Status | Whether the learner has ever answered that problem correctly (Correct, Incorrect, Not submitted). Once correct, it stays Correct even if an incorrect answer is submitted afterward |
| Total time spent | The total time the problem was open |
| Hint count | The number of times additional hints were generated for that problem. Includes hints automatically generated when an incorrect submission is made, but does not include estimates of where the error is |
| Submission count | The number of submissions to that problem. Clicking it opens a submission list filtered to that learner and problem |
When you open submission details from the submission list, you can check the content of the hint the learner last viewed and the viewing date and time as Last viewed hint information.
The speech bubble in the "AI chat" column indicates that the student has a history of asking questions to the AI in that course. Chats started from any screen of the course, material, or problem are included.
Bubbles are shown with a solid green fill if the last question was within 5 minutes; otherwise they are shown as a gray outline only.
Next to the bubble, the number of today's conversations is displayed. If there are only past conversations, no count is displayed.
Students who have never had a conversation history do not get a bubble.
Clicking the bubble lets you check today's conversations in descending order of the latest question time. If there are no questions today, that is indicated. While a summary is being generated or if it cannot be retrieved, "Questions to AI" is displayed.
Clicking a question summary lets you check the questions and AI answers in that conversation.
Clicking "View past conversations" opens the AI chat tab filtered to that student.
Hovering over the information icon in the "AI chat" heading or over a bubble lets you check the display rules and the current status.
Question history is retrieved at the same timing as the existing learning analytics. This applies to "Re-fetch data," auto refresh, changes to filter conditions, and returning to the browser tab after the retrieved data has become stale.
Opening or closing the chat panel, tab display state, and display switching due to communication interruptions do not affect it. New chats without questions are not displayed.
If there are "answer or code requests" among questions in the last 15 minutes, Answer request and the count are shown next to the bubble. If there are no "answer or code requests" but there are "error or debugging" questions, Error consultation is shown. The intent of each question is automatically classified by AI.
The display targets are chats in which students from the selected organization or group asked questions in this course. The count and the list in the bubble cover only today's conversations and show only conversations you have permission to view.
Learners who may need a check-in are displayed with the following reasons. Administrators are not displayed. If a learner has multiple reasons, they are combined into one row, and the basis is shown under Status.
The table shows, in addition to the same columns as the list of all learners (last opened problem, last activity, AI chat, status, total time spent, hint count, submission count, and progress for each displayed class), the Reason and Status columns. There are no sorting features or statistics rows.
Learners with more reasons are listed first; when the number of reasons is the same, learners with longer total time spent on the last opened problem are listed first. Learners whose only reason is Not started are shown last. Up to 10 learners who have not been addressed are shown, followed by learners marked as addressed.
| Reason | Condition for display |
|---|---|
| Long-term stall | The last opened problem is not yet correct, and there has been an operation within 5 minutes (whether or not they are asking the AI does not matter). Status shows the total time spent on that problem and the number of AI questions in the last 5 minutes |
| Repeated same error | Within the latest submissions from the last 15 minutes, there have been 3 or more consecutive incorrect submissions to the same problem (with no correct answer or submission to another problem afterward) |
| Requesting answers | There are 3 or more questions in the last 15 minutes asking for answers or code |
| Not started | The learner has neither viewed nor submitted any problem in the displayed classes (since they may be absent, they are shown after learners with other reasons) |
Checking the box at the beginning of a row marks it as addressed and displays it faintly at the end of the list. The check is saved in the browser and is cleared when the date changes. If a new reason is attached after checking, the check is cleared and the row returns to its prominent display.
This screen is for reviewing, after class, what learners got stuck on in AI chat. When you select one class under Display class, it shows questions asked in that class's materials, limited to questions from learners within the scope of Filter users.
Analyze makes the AI group the questions by topic. Analysis results are generated in the display language of the screen, saved for each class, filter condition, and display language, and displayed the next time as well. Up to 500 of the most recent questions are analyzed in the analysis; older questions are not analyzed. Questions added after analysis are shown as Not analyzed with a count, so press Re-analyze as needed. If, after analysis, the target learners fall outside the filter scope or a conversation is deleted, the previous result is not displayed and re-analysis is prompted.Frequently asked topics displays up to 10 topics asked by 2 or more people. Topics asked by only one person are grouped as Other (one person each). Pressing the Learners or Questions heading sorts by that column. Initially it is sorted by number of learners in descending order; pressing the same heading again reverses the order. In either order, the top 10 topics by the larger value are displayed, and Other (one person each) is always shown last. The Intent of questions bar shows the breakdown of question intents within a topic as color lengths, and the correspondence between colors and intents is shown next to the table heading. Hovering over each color of the bar shows that intent and its count. Pressing a topic lets you check what was not understood, hints to the material (AI-estimated), and the learners' statements and question intents. Open conversation opens the details of the relevant conversation (Check AI chat conversations). For conversations you cannot open with your conversation viewing permissions (such as when the conversation is not linked to a group or organization you manage, or to the course), Open conversation is not displayed.Download CSV saves the Frequently asked topics table as stumble-analysis.csv, in the same order as on screen. The columns are Topic, Learners, Questions, What was not understood, Hints to the material, and Material; Other (one person each) is also included as a row. Learners' statements, names, and email addresses are not included. It cannot be pressed when no analysis result is displayed.Material column of Frequently asked topics opens Improve material on that material's edit screen.By learner lists all learners, including those who have not used the chat, with their question count, number of answer or code requests, number of submissions, number of correct answers, and last question. Initially it is sorted by question count in descending order; pressing the Questions, Of which answer requests, or Correct heading sorts by that column (Correct in ascending order from the lowest). Pressing the same heading again reverses the order. Pressing a learner shows their questions and submission history in that class in chronological order.Anonymize students is enabled, learners are displayed by number.If class hours are set, each cell can distinguish whether the submission was made during class hours or outside class hours.
This lets you tell at a glance which submissions were made during class and which were made for self-study or homework. If class hours are not set, all submissions are displayed filled.
Filter users can be switched by both organization unit and group unit.Download CSV, you can choose columns such as profile information (affiliation, student ID, etc.), submission date and time, score, whether it is an excellent submission, source code, and options such as calculating the average and standard deviation. The target is the range selected under Filter users and Display class; administrators are not included. Anonymize students is not reflected in the CSV.