Refine
Document Type
- conference proceeding (article) (21)
- Book (1)
- Part of a Book (1)
Has Fulltext
- no (23)
Reviewed
- Begutachtet/Reviewed (22)
Keywords
- AI, GenAI, Generative AI, K-12, Informatics, Curricula (1)
- CS academics, recruitment, retention (1)
- ChatGPT-3.5, large language models, students, interaction pattern, application, chat protocols, introductory programming, higher education (1)
- Dispositions, meticulous, professional, competency-based educa- tion, observable learning outcomes, CC2020 Computing Curricula, qualitative analysis, student perspective (1)
- Dispositions, vignettes, professional practice (1)
- Game-Based Learning, Multimodal Learning, Natural Interaction (1)
- Large Language Models, LLMs, ChatGPT, ethics, student perspec- tive, experience report (1)
- Learning programming, expert feedback, feedback rationale, feed- back guidelines, novice programmers (1)
- Open Science , Open Data , Data publication , FAIR , DELFI , Educational Technology (1)
- Open Science, FAIR Prinzipien, Software, Forschungsdaten, Autor*innen Unterstützung, Publikationsformate, NFDIxCS (1)
Institute
With Great Power Comes Great Responsibility - Integrating Data Ethics into Computing Education
(2024)
Most computing students enter the industry once they graduate. As
future software engineers, they will be in powerful positions, making decisions that impact their personal lives, others, and society. Thus, preparing graduates for their careers is crucial by addressing ethical considerations, decision problems, and other concepts related to morals, values, and legal aspects (e.g., data protection, privacy, security, etc.) as part of computing curricula. In this paper, we propose the integration of data ethics into computing programs and provide a framework for an ethics module, including relevant competency-based learning objectives. The proposed module is based on a curricular analysis of all 71 German data science degree programs focusing on ethics courses. The course contents and competency goals were analyzed and classified based on their cognitive complexity. As the results proved the lack of competency-
based learning outcomes, we designed observable competency goals, meaning knowledge, skills, and dispositions taken in the context of a task. In addition, we provide suggestions for contents, pedagogical instructions, and assessments in such a course. The proposed module serves as a first draft and resource to support other educators aiming to design such a course and who are willing to integrate it into computing curricula.
This book covers a qualitative study on the programming competencies of novice learners in higher education. To be precise, the book investigates the expected programming competencies within basic programming education at universities and the extent to which the Computer Science curricula fail to provide transparent, observable learning outcomes and assessable competencies. The study analyzes empirical data on 35 exemplary universities' curricula and interviews with experts in the field. The book covers research desiderata, research design and methodology, an in-depth data analysis, and a presentation and discussion of results in the context of programming education. Addressing programming competency in such great detail is essential due to the increasing relevance of computing in today’s society and the need for competent programmers who will help shape our future.
Although programming is a core tier of computing and many related disciplines, learning how to program can be challenging in higher education, and many students fail in introductory programming. The book aims to understand what programming means, what programming competency encompasses, and what teachers expect of novice learners. In addition, it illustrates the cognitive complexity of programming as an advanced competency, including knowledge, skills, and dispositions in context. So, the purpose is to communicate the breadth and depth of programming competency to educators and learners of programming, including institutions, curriculum designers, and accreditation bodies. Moreover, the book’s goal is to represent how a qualitative research methodology can be applied in the context of computing education research, as the qualitative research paradigm is still an exception in computing education research.
The book provides new insights into programming competency. It outlines the components of programming competencies in terms of knowledge, skills, and dispositions and their cognitive complexity according to the CC2020 computing curricula and the Anderson-Krathwohl taxonomy of the cognitive domain. These insights are essential as programming constitutes one of the most relevant competencies in all computing study programs. In addition, being able to program describes the capability of solving problems, which is also a core competency in today’s increasingly digitalized society. In particular, the book reveals the great relevance of dispositions and other competency components in programming education, which curricula currently fail to recognize and specify. In addition, the book outlines the resulting implications for higher education institutions, educators, and student expectations. Yet another result of interest to graduate students is the multi-method study design that allows for the triangulation of data and results.
Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics
(2024)
The advent of Large Language Models (LLMs) started a serious discussion among educators on how LLMs would affect, e.g., curricula, assessments, and students' competencies. Generative AI and LLMs also raised ethical questions and concerns for computing educators and professionals.
This experience report presents an assignment within a course on professional competencies, including some related to ethics, that computing master's students need in their careers. For the assignment, student groups discussed the ethical process by Lennerfors et al. by analyzing a case: a fictional researcher considers whether to attend the real CHI 2024 conference in Hawaii. The tasks were (1) to participate in in-class discussions on the case, (2) to use an LLM of their choice as a discussion partner for said case, and (3) to document both discussions, reflecting on their use of the LLM.
Students reported positive experiences with the LLM as a way to increase their knowledge and understanding, although some identified limitations. The LLM provided a wider set of options for action in the studied case, including unfeasible ones. The LLM would not select a course of action, so students had to choose themselves, which they saw as coherent.
From the educators' perspective, there is a need for more instruction for students using LLMs: some students did not perceive the tools as such but rather as an authoritative knowledge base. Therefore, this work has implications for educators considering the use of LLMs as discussion partners or tools to practice critical thinking, especially in computing ethics education.
The use and adoption of Generative AI (GenAI) has revolutionised
various sectors, including computing education. However, this narrow focus comes at a cost to the wider AI in and for educational research. This working group aims to explore current trends and explore multiple sources of information to identify areas of AI research in K-12 informatics education that are being underserved but needed in the post-GenAI AI era. Our research focuses on three areas: curriculum, teacher-professional learning and policy. The denouement of this aims to identify trends and shortfalls for AI in and for K-12 informatics education. We will systematically review the current literature to identify themes and emerging trends in AI education at K-12. This will be done under two facets, curricula and teacher-professional learning. In addition, we will conduct interviews and surveys with educators and AI experts. Next, we will examine the current policy (such as the European AI Act, and Euro-
pean Commission guidelines on the use of AI and data in education
and training as well as international counterparts). Policies are often developed by both educators and experts in the domain, thus providing a source of topics or areas that may be added to our findings. Finally, by synthesising insights from educators, AI experts, and policymakers, as well as the literature and policy, our working group seeks to highlight possible future trends and shortfalls.
Generative AI (GenAI) has seen great advancements in the past two years and the conversation around adoption is increasing. Widely available GenAI tools are disrupting classroom practices as they can write and explain code with minimal student prompting. While most acknowledge that there is no way to stop students from using such tools, a consensus has yet to form on how students should use them if they choose to do so. At the same time, researchers have begun to introduce new pedagogical tools that integrate GenAI into computing curricula. These new tools offer students personalized help or attempt to teach prompting skills without undercutting code comprehension. This working group aims to detail the current landscape of education-focused GenAI tools and teaching approaches, present gaps where new tools or approaches could appear, identify good practice-examples, and provide a guide for instructors to utilize GenAI as they continue to adapt to this new era.
Computing education research (CER) is a rapidly advancing discipline, offering vast potential for data-driven, secondary research or replication studies. Although gathering and analyzing data for research seem straightforward, making research data publicly available to the community remains a challenge. Likewise, finding and reusing high-quality, prominent, and well-documented research data proves to be a daunting task. In this working group paper, the authors present their search for available datasets in the CER context (e.g., in databases and repositories). The available datasets are further analyzed using a newly developed metadata scheme and presented to the community as a resource. The second component of this work is a summary of the community’s perspective and concerns on publishing their research data, which has been gathered through a survey among 52 computing education researchers. Based on this status quo, this report presents recommendations for measures and future steps for the community to become more accessible and establish open data practices. We thus emphasize the potential of making research data available to enhance productivity, transparency, and reproducibility in the CER community.
Ever since Large Language Models (LLMs) and related applications have become broadly available, several studies investigated their potential for assisting educators and supporting students in higher education. LLMs such as Codex, GPT-3.5, and GPT 4 have shown promising results in the context of large programming courses, where students can benefit from feedback and hints if provided timely and at scale. This paper explores the quality of GPT-4 Turbo's generated output for prompts containing both the programming task specification and a student's submission as input. Two assignments from an introductory programming course were selected, and GPT-4 was asked to generate feedback for 55 randomly chosen, authentic student programming submissions. The output was qualitatively analyzed regarding correctness, personalization, fault localization, and other features identified in the material. Compared to prior work and analyses of GPT-3.5, GPT-4 Turbo shows notable improvements. For example, the output is more structured and consistent. GPT-4 Turbo can also accurately identify invalid casing in student programs' output. In some cases, the feedback also includes the output of the student program. At the same time, inconsistent feedback was noted such as stating that the submission is correct but an error needs to be fixed. The present work increases our understanding of LLMs' potential, limitations, and how to integrate them into e-assessment systems, pedagogical scenarios, and instructing students who are using applications based on GPT-4.
Vignettes are short stories along with a set of questions that engage the reader to comment on the story. Vignettes have been used in professional academic programs (e.g., teacher preparation and medical education), for professional development in various fields (e.g., teaching ethics in psychology and medicine), and in various research fields for data collection. In this work, vignettes are used to elicit students’ understanding
of dispositions in computing education. Professional dispositions enable behaviors that are valued in the workplace, such as adaptability or self-directedness. They are often explicitly stated in computing job postings. While the relevance of dispositions is widely recognized in the workplace, only recently have curricular guidelines for computing programs recognized professional dispositions as an integral part of competencies and as complementary to knowledge and skills. There is scarce literature on the use of vignettes in teaching undergraduate computing, or on how best to foster dispositions in students. In this project, four faculty
from four diverse institutions in the U.S., along with three consulting experts, have collaborated to design and evaluate the use of vignettes in the classroom. This paper documents researchers’ efforts to gain insights into students’ perceptions of dispositions through the use of vignettes. Such insights may guide educators to identify pedagogical strategies for fostering dispositions among students. This paper presents an iterative
process for vignette design with continuous review by researchers and focus group members. The vignettes in this study use stories of situations which demonstrate the application of a disposition, drawn from various fields and walks of life to represent diverse groups and experiences. Students are presented with the vignette story and asked to identify the disposition illustrated. To elicit students’ understanding of dispositions in terms of their personal behaviors, students are asked to describe a situation in which they have experienced the disposition. Lessons learned in the design and use of vignettes are discussed.
The advantages of the current digital evolution foster the responsibility of having technical advancements, applications, and tools reflect the societal needs regarding diversity, equality, inclusion, and accessibility (DEIA) within disciplines and organizations. These four elements should become part of all accreditation criteria and processes for engineering, computing, and other related programs, where accreditation bodies, higher education institutions, and educators become ready to implement these elements in any new setting. This work continues the discussion of an earlier paper that addresses the meaning of three of these four concepts in the context of accreditation. It also emphasizes the potential benefits for technical professions, future engineers, and the ICACIT accrediting agency. Hence, it is essential not only to integrate diversity, equity, inclusion, and accessibility in higher education study programs and global accreditation criteria but also to seek both quantitative and qualitative methods to evaluate these DEIA elements to ensure all students receive the best possible university education.