How do we get there? Steps towards systemic adoption of
learning analytics
Dragan Gašević@dgasevic
October 21, 2016
http://sheilaproject.eu
Educational Landscape Today
Growing need for educationActive learning
Education defunding
Feedback loops between students and instructors
are missing/weak!
LEARNING ANALYTICS
Learning environment
Educators
LearnersStudent
Information Systems
Blogs
Videos/slides
Mobile
Search
Educators
Learners
Networks
Student Information
Systems
Learning environment
Blogs
Mobile
Search
Networks
Educators
LearnersStudent
Information Systems
Learning environment
Videos/slides
CASE STUDIES
Student retention
Year 1 Year 2 Year 3 Year 40.00%
10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%
100.00%
Course SignalsNo Course Signals
Arnold, K. E., & Pistilli, M. D. (2012, April). Course Signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267-270).
Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using Signals for appropriate feedback: Perceptions and practices. Computers & Education, 57(4), 2414-2422.
Can teaching be improved?
Wright, M. C., McKay, T., Hershock, C., Miller, K., & Tritz, J. (2014). Better Than Expected: Using Learning Analytics to Promote Student Success in Gateway Science. Change: The Magazine of Higher Learning, 46(1), 28-34.
INSTITUTIONAL ADOPTION: CURRENT STATE
Very few institution-wide examples of adoption
Sophistication model
Siemens, G., Dawson, S., & Lynch, G. (2014). Improving the Quality and Productivity of the Higher Education Sector - Policy and Strategy for Systems-Level Deployment of Learning Analytics. Canberra, Australia: Office of Learning and Teaching, Australian Government. Retrieved from http://solaresearch.org/Policy_Strategy_Analytics.pdf
Sophistication model
Siemens, G., Dawson, S., & Lynch, G. (2014). Improving the Quality and Productivity of the Higher Education Sector - Policy and Strategy for Systems-Level Deployment of Learning Analytics. Canberra, Australia: Office of Learning and Teaching, Australian Government. Retrieved from http://solaresearch.org/Policy_Strategy_Analytics.pdf
Current state – Oz and Europe
http://sheilaproject.eu/http://he-analytics.com
Adoption challenge
Lack of leadership for implementation & monitoring
Lack of leadership
Bought an analytics product.
Analytics box ticked!
Adoption challenge
Lack of equal engagement with different stakeholders
Adoption challenge
Lack of sufficient training to use learning analytics
Adoption challenge
Lack of policies for learning analytics practice
What’s necessary to move forward?
DIRECTIONS
Data – Model – Transformation
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83, https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Data – Model – Transformation
Creative data sourcing
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83, https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Social networks are everywhere
Gašević, D., Zouaq, A., Jenzen, R. (2013). ‘Choose your Classmates, your GPA is at Stake!’ The Association of Cross-Class Social Ties and Academic Performance. American Behavioral Scientist, 57(10), 1459–1478.
Data – Model – Transformation
Creative data sourcingNecessary IT support
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83, https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Data – Model – Transformation
Question-driven, not data-driven
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83, https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Learning analytics is about learning
Gašević, D., Dawson, S., Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64-71.
One size fits all does not work in learning analytics
Gašević, D., Dawson, S., Rogers, T., Gašević, D. (2016). Learning analytics should not promote one size fits all: The effects of course-specific technology use in predicting academic success. The Internet and Higher Education, 28, 68–84.
Learning context
Instructional conditions shape learning analytics results
Learner agency
Kovanović, V., Gašević, D., Joksimović, S., Hatala, M., Adesope, S. (2015). Analytics of Communities of Inquiry: Effects of Learning Technology Use on Cognitive Presence in Asynchronous Online Discussions. The Internet and Higher Education, 27, 74–89.
More time online does not always mean better learning
Data – Model – Transformation
Participatory design of analytics tools
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83, https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Data – Model – Transformation
Participatory design of analytics toolsAnalytics tools for non-statistics experts
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83, https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Visualizations can be harmful
Corrin, L., & de Barba, P. (2014). Exploring students’ interpretation of feedback delivered through learning analytics dashboards. In Proceedings of the ascilite 2014 conference (pp. 629-633). ascilite.
Students don’t perceive dashboards as feedback
Pardo, A., Jovanovic, J. Dawson, S., Gasevic, D. (in preparation). Using Learning Analytics to Scale the Provision of Personalised Feedback.
Data – Model – Transformation
Participatory design of analytics toolsAnalytics tools for non-statistics expertsDevelop capabilities to exploit (big) data
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83, https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Marr, B. (Oct 2015). Forget Data Scientists - Make Everyone Data Savvy, http://www.datasciencecentral.com/m/blogpost?id=6448529%3ABlogPost%3A337288
Policy development
http://sheilaproject.eu/
FINAL REMARKS
Rhetoric of simplistic technological fixes
is unproductive
Embracing complexity of educational systems
Capacity development
Multidisciplinary teams in institutions critical
Ethical and privacy considerationDevelopment of data privacy agency
Prinsloo, P., & Slade, S. (2015). Student privacy self-management: implications for learning analytics. In Proceedings of the Fifth International Conference on Learning Analytics And Knowledge (pp. 83-92). ACM.
Sclater, N. (2014). Code of practice for learning analytics: A literature review of the ethical and legal issues. http://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf
Development of analytics culture
Manyika, J. et al. (2011). Big Data: The Next Frontier for Innovation, Competition, and Productivity. McKinsey Global Institute, http://goo.gl/Lue3qs
Thank you!