Insights Portal now available for MSU D2L course analytics

MSU course admins and editors now have access to the Insights Portal for more advanced analytics reporting on courses in MSU D2L (Brightspace).

The Insights Portal now enables educators to use MSU D2L course statistics and visualizations to track, measure, and monitor student progress and help improve learner engagement aiding in student success.

Advanced features beyond the core course analytics in D2L include the Course Overview Widget, the Class Engagement Dashboard, and a variety of Portal Reports (hourly + daily). See below for some tips on using the D2L Insights Portal.

Course Overview Widget

The Course Overview widget provides an at-a-glance visual of course access over the past week. Hovering over each bar in the graph indicates the number of people that have accessed the site each day. Links within the widget give quick access to other Insights reports on Class Engagement (also found on the Classlist page – more details below), Course Access, and Tool Access.

The widget is now available on the standard MSU Course Homepage. You may need to add the widget if you have a custom homepage.

Shows bar graphs representing course access over last seven days plus links in course overview widget

Course Access Report

bar graph of course access report for a specified date range

The Course Access report can be customized to select by roles and date range. Click and drag on the edge of the shaded rectangle (also referred to as a sparkline) to increase the date range for the report.

The number of course access events can be downloaded as an Excel or CSV spreadsheet for further data analysis and record keeping.

 

 

Tool Access Report

pie chart with tool access - grades has been viewed 50 times showing as hover textThe Tool Access report gives a closer look at the tools being used for select date ranges. Hover over the pie chart or access the table underneath it for individual tool access events. This data can also be exported.

time span options shown as last 7 days, last 30 days, last 12 months

 

 

 

 

Class Engagement Dashboard

The Class Engagement Dashboard can be accessed via a link in the Course Overview widget, as well as from a button at the top of the course Classlist.

Class Engagement button circled

The Class Engagement Dashboard displays the number of students that have not accessed the course in the past seven days and an interactive bar graph of the current Grade Distribution that lets instructors filter a class list by grade ranges and then initiate interventions via email.

Click on grade ranges to filter students. Check the select all box, and click on “Email Selected” to send a bcc message to students fitting the criteria (selected grade range).

shows number of students who have not visited the course in the past 7 days and a grade distribution graph with filters and an "email selected" button
The dashboard also displays a sortable table of values including the Current grade, Last visited, and number of Discussion posts (as of July 24 when Insights was turn on in the system).

Clicking on values within the table will direct you to the student progress report. Keep in mind that the progress view is limited to the course end date. Insights reports are not limited by the course end date.

Portal Reports (hourly + daily)

Insights Portal iconThe Insights Portal reports can be accessed from the Edit Course menu or from the Course Tools menu options in a standard navigation bar.

Course Tools menu pulldown including Insights Portal option

There are a variety of reports to access with descriptions in the last column.

Running a report

To run an Insights report:

  1. Click on the title of the report.
  2. Click on “Select Values” for Roles (e.g., Select All, just Students).
  3. Enter other filter criteria such as thresholds (varies depending on the report).
  4. After making selections, click “Run Report.”
  5. Click on “Show Filters” to change criteria for another report.
  6. Reports can be exported as PDF, Excel, CSV, and XLSX files.
  7. When finished, click “Done.”

Examples shown below include Academic Risk, Course Access Details, Quiz Item Analysis, and Quiz Question Statistics.

Academic Risk: Displays academically at-risk students filtered by the calculated grade with a selected risk threshold.

Academic Risk report visuals
NOTE: Click the play icons wherever they occur to display charts.

Course Access Details: Displays course access statistics for each user over a selected date range, as well as a horizontal bar graph indicating the percentage of students meeting the filter criteria, such as enrolled with no access.

The following shows a graph of a large enrollment course over the first two days of the semester, showing that 35% of the students had not accessed the class.

ratio of participants with no access to course yet 35%

Quiz Item Analysis: This report is limited to quizzes with multiple choice questions that have only one correct answer each. The question order can be random, but all learners must receive the same set of questions. The report assesses results for the first quiz attempt only.

This report interprets the number of first attempts, total points, standard deviation, reliability coefficient, highest and lowest scores, upper quartile, lower quartile, and median and average scores. The table of values also includes the following data per question: Percent correct, discrimination index, point biserial, and response frequencies.

detailed report image per question stats

Read more on Interpreting the Quiz Item Analysis report.

Quiz Question Statistics: The report has both a Summary view and a Detailed view. The Summary view shows course quiz question responses and final quiz score distributions. Comparing the grade of the quiz question to the student quiz grades lets the instructor understand the distribution of results and whether the question separates the top students from everyone else.

per question quiz stats comparing question score with overall quiz score range
The Detailed view shows what other questions the student is likely to have answered incorrectly. The report displays the most problematic questions first.

Read more on Interpreting the Quiz Question Statistics report.

Core Analytics

If you are not already aware of the many pre-existing course and user statistics available to instructors, you may want to also explore the following areas available without Insights.

  1. Content > Table of Contents > Related Tools > View Reports – View the number of users visiting each content item with average time spent. Clicking on the numbers will display detailed content item statistics per user. The Users tab gives a clear picture of all content items accessed by an individual when you click on their name. The table shows number of visits, average time spent, and the last visit.
  2. Assessments > Class Progress – Displays an overview of items in a course. Go to the settings to replace an existing area with another choice. Clicking on a student’s name gives more details with summaries at the top and drill down reports. A new feature turned on with Insights, shows the Course Access history over the last 30 days.dashboard showing content, discussions, logins, and grade stats
  3. Communication > Discussions > Statistics – Displays a table with number of Threads and Replies, as well as number of posts read by each user. The columns are sortable by clicking on the headings.
    Discussion stats including number of threads, replies, and posts read
  4. Assessments > Quizzes > Statistics (see options across the top) – Summary shows quiz averages. Click on a quiz to see more details including User Stats, Question Stats, and Question Details. The Question Stats list the Standard Deviation, Discrimination Index, and Point Biserial for each question. You can click on the link above the table to learn more about what the statistics mean. For more, view the video on Generating Reports in D2L Learning Environment.
    table showing question stats - standard deviation, discrimination index, and point biserial
  5. Assessments > Grades > (Grade Item) Statistics – Use the pulldown menu by a grade item title and select Statistics to display Class and User Statistics.
    grade item stats including min, max, average, mode, median, standard deviation and grade distribution graph
  6. Assessments > Rubrics > (item) Statistics – Use the pulldown menu by a title and select Statistics. Select from tabs to view Overall, Criteria Statistics, and Individual Statistics.
    rubric stats with levels per criteria row

Working with student data

Keep the MSU Institutional Data Policy in mind when storing data and making reports public in order to protect the security and confidentiality of student data. Read more about best practices for handling data.

More Resources

For further questions, contact the MSU IT Service Desk at (517) 432-6200 or ithelp@msu.edu.