International Large-Scale Assessments (ILSA) have a critical role in shaping education systems around the world. They impact local and national education policy and receive much attention in the media and the public discourse. However, the public has limited access to the results and cannot learn from them. Subsequently, the media might frame the results incorrectly. The transparency of ILSA is essential to the advancement of the public discourse. It requires easy access to data together with simple analysis tools. However, the complexity of ILSA makes it hard to understand and to analyze. Open PISA tries to deal with this challenge by developing a dashboard for the Program for International Student Assessment (PISA). It aims to guide users in the analysis of the dataset. This paper describes the dashboard design and insight based on collected users' responses. It hypothesizes that full transparency of the PISA dataset might be not achievable to the entire public. Further research is needed to evaluate how dataset analysis affects users' knowledge and opinions.
|Title of host publication||L@S 2020 - Proceedings of the 7th ACM Conference on Learning @ Scale|
|Publisher||Association for Computing Machinery|
|Number of pages||4|
|State||Published - 12 Aug 2020|
|Event||7th Annual ACM Conference on Learning at Scale, L@S 2020 - Virtual, Online, United States|
Duration: 12 Aug 2020 → 14 Aug 2020
|Name||L@S 2020 - Proceedings of the 7th ACM Conference on Learning @ Scale|
|Conference||7th Annual ACM Conference on Learning at Scale, L@S 2020|
|Period||12/08/20 → 14/08/20|
Bibliographical noteFunding Information:
Much appreciation to the people who provided helpful comments during the development of the dashboard design. The authors gratefully acknowledge the grant of the Trump Foundation for the dashboard development and scholarships, the support of the AllCloud company for cloud hosting, and the infographics advising of the Infoserviz company.
© 2020 ACM.
- citizen science
- international large-scale assessments
- statistical literacy
ASJC Scopus subject areas
- Computer Networks and Communications