Towards a consensus on program elements of specialized computer science / information technology (CS/IT) programs in high schools
A Delphi study
Keywords:
computer science, information technology, high school, programsAbstract
In our increasingly technological and advanced times, demand for K-12 education in computer science and information technology (CS/IT) is growing. Current data offer insight into student access to computer science education and course-taking. In addition to the expansion of individual course offerings, there is also a growing number of specialized CS/IT programs in high schools. However, there has been no systematic attempt to document the landscape of those programs. This study is part of a larger landscape study of secondary CS/IT programs in Virginia and uses a consensus-based approach to identify the common elements that expert and practitioner panelists believe should be included in such a program. The results reveal strong consensus on a wide range of program goals, activities, and curricular elements, suggesting that there are many opportunities to create purposeful and coherent CS/IT programs in high schools.
Downloads
References
Aivaloglou, E., & Hermans, F. (2019). Early Programming Education and Career Orientation: The Effects of Gender, Self-Efficacy, Motivation and Stereotypes. Proceedings of the 50th ACM Technical Symposium on Computer Science Education, 679–685. https://doi.org/10.1145/3287324.3287358
Aritajati, C., Rosson, M. B., Pena, J., Cinque, D., & Segura, A. (2015). A Socio-Cognitive Analysis of Summer Camp Outcomes and Experiences. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education., 581–586. DOI: https://doi.org/10.1145/2676723.2677292
Armoni, M., & Gal-Ezer, J. (2023). High-school computer science – Its effect on the choice of higher education. Informatics in Education, 22(2), 183-206. https://doi.org/10.15388/infedu.2023.14
Bae, C.L., & Lai, M.H. (2020). Opportunities to participate in science learning and student engagement: A mixed methods approach to examining person and context factors. Journal of Educational Psychology, 112(6), 1128–1153. http://dx.doi.org/10.1037/edu0000410
Bottia, M.C., Stearns, E., Mickelson, R.A., Moller, S., & Parker, A.D. (2015). The relationships among high school STEM learning experiences and students’ intent to declare and declaration of a STEM major in college. Teachers College Record, 117(3), 1-46.
Bottia, M.C., Mickelson, R.A., Jamil, C., Giersch, J., Stearns, E., & Moller, S. (2018). The role of high school racial composition and opportunities to learn in students’ STEM college participation. Review of Educational Research 55, 446–476. DOI: https://doi.org/10.1002/tea.21426
Calabrese Barton, A. & Tan, E. (2009). Funds of knowledge and discourses and hybrid space. Journal of Research in Science Teaching, 46(1), 50-73. DOI: https://doi.org/10.1002/tea.20269
Clarke-Midura, J., Sun, C., & Pantic, K. (2020). Making apps: An approach to recruiting youth to computer science. ACM Transactions on Computing Education, 20(4), 1-23. https://doi.org/10.1145/3425710
Code.org, Computer Science Teachers Association, & Expanding Computing Education Pathways Alliance. (2023). 2023 State of computer science education. https://advocacy.code.org/2023_state_of_cs.pdf
Commonwealth of Virginia Board of Education. (2017). Computer science Standards of Learning for Virginia public schools. https://www.doe.virginia.gov/home/showpublisheddocument/9926/638026394162470000
Commonwealth of Virginia Board of Education. (2020). Digital learning integration Standards of Learning for Virginia public schools. https://www.doe.virginia.gov/home/showpublisheddocument/11286/638031727527100000
Corning, A., Becker, J., Broda, M., Hope, S., Lucas, B., Senechal, J., Sions, H. (2021). CodeRVA’s Fourth Year Report. Metropolitan Educational Research Consortium.
Corning, A., Broda, M. D., Lucas, B. L., Becker, J. D., & Bae, C. L. (2023). An inclusive school for computer science: Evaluating early impact with propensity score matching. Studies in Educational Evaluation, 79, 1-13. https://doi.org/10.1016/j.stueduc.2023.101293
Crowder, A., Dovi, R., & Naff, D. (2020). Integrated STEM education in Virginia: CodeVA Elementary Coaches Academy. In J. Anderson & Y. Li (Eds) Integrated approaches to STEM education: An international perspective (pp. 447-467). Springer.
Diamond, I. R., Grant, R. C., Feldman, B. M., Pencharz, P. B., Ling, S. C., Moore, A. M., & Wales, P. W. (2014). Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. Journal of clinical epidemiology, 67(4), 401-409. DOI: https://doi.org/10.1016/j.jclinepi.2013.12.002
Drumm, S., Bradley, C., & Moriarty, F. (2022). ‘More of an art than a science?’ The development, design, and mechanics of the Delphi Technique. Research in Social and Administrative Pharmacy, 18(1), 2230-2236. https://doi.org/10.1016/j.sapharm.2021.06.027
ECEP (Expanding Computing Education Pathways). (2022a). Landscape reports. https://ecepalliance.org/resources/toolkits-guides/landscape-reports/
ECEP (Expanding Computing Education Pathways). (2022b). State data dashboards. https://ecepalliance.org/cs-data/state-data-dashboards/
Eisenhart, M., & Allen, C.D. (2020). Addressing underrepresentation of young women of color in engineering and computing through the lens of sociocultural theory. Cultural Studies of Science Education, 15, 793–824.
Elizabeth Casey, J., Gill, P., Pennington, L., & Mireles, S. V. (2017). Lines, roamers, and squares: Oh my! using floor robots to enhance Hispanic students’ understanding of programming. Education and Information Technologies, 23 (4), 1531–1546. https: //doi.org/10.1007/s10639-017-9677-z DOI: https://doi.org/10.1007/s10639-017-9677-z
Foth, T., Efstathiou, N., Vanderspank-Wright, B., Ufholz, L. A., Dütthorn, N., Zimansky, M., & Humphrey-Murto, S. (2016). The use of Delphi and Nominal Group Technique in nursing education: A review. International journal of nursing studies, 60, 112-120. DOI: https://doi.org/10.1016/j.ijnurstu.2016.04.015
Gamoran, A. (2016). Will latest U.S. law lead to successful schools in STEM? Science, 353(6305), 1209-1211. DOI: https://doi.org/10.1126/science.aah4037
Giani, M. (2022). How attaining industry-recognized credentials in high school shapes education and employment outcomes. Thomas B. Fordham Institute. https://files.eric.ed.gov/fulltext/ED625598.pdf
Gray, D.L., Hope, E.C., & Matthews, J.S. (2018). Black and belonging at school: A case for interpersonal, instructional, and institutional opportunity structures. Educational Psychologist, 53(2), 97–113. DOI: https://doi.org/10.1080/00461520.2017.1421466
Karpiński, Z., Biagi, F., & Di Pietro, G. (2021). Computational thinking, socioeconomic gaps, and policy implications. IEA Compass: Briefs in Education No. 12. IEA.
Kwon, K., Ottenbreit-Leftwich, A. T., Brush, T. A., Jeon, M., & Yan, G. (2021). Integration of problem-based learning in elementary computer science education: effects on computational thinking and attitudes. Educational Technology Research and Development, 69, 2761-2787.
Lee, A. (2015). Determining the effects of computer science education at the secondary level on STEM major choices in postsecondary institutions in the United States. Computers & Education, 88. https://doi.org/10.1016/j.compedu.2015.04.019 DOI: https://doi.org/10.1016/j.compedu.2015.04.019
Lee, S. J., Francom, G. M., & Nuatomue, J. (2022). Computer science education and K-12 students’ computational thinking: A systematic review. International Journal of Educational Research, 114, 102008.
Legewie, J., & DiPrete, T.A. (2014). The high school environment and the gender gap in science and engineering. Sociology of Education, 87(4), 259–280. DOI: https://doi.org/10.1177/0038040714547770
Marshall, S. L., & Grooms, A. A. (2022). Industry’s push for computer science education: Is computer science really for all?. Policy Futures in Education. https://doi.org/10.1177/14782103211045601
Master, A., Cheryan, S., & Meltzoff, A.N. (2016). Computing whether she belongs: Stereotypes undermine girls’ interest and sense of belonging in computer science. Journal of Educational Psychology, 108(3), 424–437. DOI: https://doi.org/10.1037/edu0000061
Means, B., Wang, H., Young, V., Peters, V.L., & Lynch, S.J. (2016). STEM-focused high schools as a strategy for enhancing readiness for postsecondary STEM programs. Journal of Research in Science Teaching, 53(5), 709–736. DOI: https://doi.org/10.1002/tea.21313
Means, B., Wang, H., Wei, X., Lynch, S., Peters, V., Young, V., & Allen, C. (2017). Expanding STEM opportunities through inclusive STEM-focused high schools. Science Education, 101(5), 681–715. DOI: https://doi.org/10.1002/sce.21281
Means, B., Wang, H., Wei, X., Iwatani, E., & Peters, V. (2018). Broadening participation in STEM college majors: Effects of attending a STEM-focused high school. AERA Open, 4(4), 1–17.
Muraski, J. M., & Iversen, J. (2022). Growing Computer Science and Information Technology Education in K-12: Industry Demand and Ecosystem Support. Journal of the Midwest Association for Information Systems (JMWAIS), 2022(2), 2.
NASEM (National Academies of Sciences, Engineering, and Medicine). (2021). Cultivating interest and competencies in computing: Authentic experiences and design factors. The National Academies Press. https://doi.org/10.17226/25912
National Research Council. (2011). Successful K-12 STEM education: Identifying effective approaches in science, technology, engineering, and mathematics. The National Academies Press. https://doi.org/10.17226/13158. DOI: https://doi.org/10.17226/13158
Perez, T., Cromley, J. G., & Kaplan, A. (2014). The role of identity development, values, and costs in college STEM retention. Journal of Educational Psychology, 106(1), 315–329. https://doi.org/10.1037/a0034027 DOI: https://doi.org/10.1037/a0034027
Ryoo, J.J., Margolis, J., Lee, C.H., Sandoval, C.D.M., & Goode, J. (2013). Democratizing computer science knowledge: Transforming the face of computer science through public high school education. Learning, Media, and Technology, 38(2), 161–181. DOI: https://doi.org/10.1080/17439884.2013.756514
Sabin, M. C., Deloge, R., Smith, A., & DuBow, W. (2017). Summer learning experience for girls in grades 7–9 boosts confidence and interest in computing careers. Journal of Computing Sciences in Colleges..
Sáez-López, JM., Sevillano-García, ML. & Vazquez-Cano, E. (2019). The effect of programming on primary school students’ mathematical and scientific understanding: educational use of mBot. Education Tech Research Dev 67, 1405–1425. https://doi.org/10.1007/s11423-019-09648-5
Shah, N., & Yadav, A. (2023). Racial justice amidst the dangers of computing creep: A dialogue. TechTrends, 67, 467-474. https://link.springer.com/article/10.1007/s11528-023-00835-z
Starrett, C., Doman, M., & Garrison, C. (2015). Computational Bead Design: A Pilot Summer Camp in Computer Aided Design and 3D Printing for Middle School Girls. Proceedings of the 46th ACM Technical Symposium on Computer Science Education, 4. https://doi.org/http://dx.doi.org/10.1145/2676723.2677303 DOI: https://doi.org/10.1145/2676723.2677303
Tucker, A., McCowan, D., Deek, F., Stephenson, C., Jones, J., & Verno, A. (2006). A model curriculum for K-12 computer science: Report of the ACM K-12 task force curriculum committee (2nd ed.). Association for Computing Machinery.
Virginia Department of Education. (2022a). Computer science. https://www.doe.virginia.gov/teaching-learning-assessment/instruction/computer-science
Virginia Department of Education. (2022b). CTE Governor’s STEM Academies. https://www.doe.virginia.gov/teaching-learning-assessment/k-12-standards-instruction/career-and-technical-education-cte/governor-s-stem-academies
Virginia Department of Education. (2022c). Governor’s schools. https://www.doe.virginia.gov/teaching-learning-assessment/specialized-instruction/governor-s-schools
Virginia Department of Education. (2022d). Profile of a Virginia graduate. https://www.doe.virginia.gov/parents-students/for-students/graduation/policy-initiatives/profile-of-a-virginia-graduate
Webb, H. C., & Rosson, M. B. (2011, March). Exploring careers while learning Alice 3D: A summer camp for middle school girls. In Proceedings of the 42nd ACM technical symposium on Computer science education (pp. 377-382). DOI: https://doi.org/10.1145/1953163.1953275
Published
How to Cite
Issue
Section
Copyright (c) 2026 Jon Becker, Amy Corning, Jon Graham, James Carrigan

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).