Aspects Beta Feedback

[bmtcril]

This epic is to capture feedback from beta testers, though not necessarily every piece of feedback will make it into v1 we can link tickets in various repos from here.

Data WG Demo Feedback 2023-09-20:

• General - We may want to add section / subsection filters and/or prepend problem / video / etc. names with the section and subsection and sort by them (Feat: Include section / subsection in block names tutor-contrib-aspects#436)
• Course Enrollment - Clarify text around enrollment mode changes if they are impacting the “Events per day” numbers (moving between modes can create implicit unenroll/enroll events)
• Problem Engagement - Responses per problem may be bonkers with a large course
• Problem Performance - Answer name, especially multi-select answers get unreadably long. Andy suggested a dimension per answer which seems reasonable
• Problem Performance - Distribution of attempts and Distribution of hints would make more sense if we could overlay the number attempts / hints allowed for the problem. Maybe something similar for Distribution of Problem Grades, where true/false will always bucket into 0-9% and 90-100%, but other problems may have more nuance
• Video Engagement - Transcripts text should be updated to indicate whether we get an event only when a user clicks or if we get one any time they watch a video with it enabled (I believe it’s the latter). We should include a language breakdown for transcripts / cc as well
• Ensure that all date charts have date labels on them, otherwise it's unclear that date filters are in play
• Make block labels on charts into links back to Studio or LMS so it's easier to find them. This is likely to require a custom visualization, but probably worth it

[bmtcril]

I'm going to close this in favor of the work @crathbun428 has done with user interviews, but feel free to make tickets for anything you think we should keep in mind Chelsea.