The Research Assessment for Ethics, Data, and AI Discussion Series launched with the aim of addressing the vital need for reform in research assessment practices to reflect the realities of our increasingly digitised world. The event gathered experts, scholars, and practitioners in research governance and digitisation to explore the intersection of research assessment and digital advancements.

The series was convened to create a collaborative dialogue to enable stakeholders to engage with the evolving landscape of research, particularly as data and AI are in the process of reshaping the process of evaluating research quality. As we navigate the complexities of the digital age, it is crucial that research is assessed in ways that uphold ethical standards and promote integrity. 

Kathryn Bailey, Professor in Research Governance Partnerships at the University of Exeter, introduced the event by outlining the overarching goals of the series: to foster critical discussions and provide necessary tools for navigating the challenges presented by the digital environment. The event highlighted the importance of integrating research ethics into practices that utilise modern technologies, addressing concerns about how these tools can influence not only academic outcomes but also societal understanding and engagement with research findings.

The series brings together several initiatives, including the Coalition for the Advancement of Research Assessment (CoARA). This growing coalition of organisations is supported by the European University Association, Science Europe, and the European Commission. The initiative emphasises responsible research assessment, particularly in relation to data and AI. Its working group on Ethics and Research Integrity Policy for Responsible Research Assessment (ERIP) focuses on developing policies and tools that promote ethical standards essential for modern research methodologies.

Additionally, the International Data Policy Committee of the International Science Council’s Committee on Data (CODATA) which advocates for effective policies regarding open science and fair data practices, contributing to this series. The Research Data Alliance’s Data Visitation Working Group is also involved.

The Ethical Data Initiative, co-led by the University of Exeter and the Technical University of Munich, which serves as a platform for engaging with philosophical, historical, and social studies of science in the context of data work, plays a key role in organising the series.

Issues and concerns around access and equity resurfaced throughout the debate. Dr. Thandie Hara, who works on Equality, Diversity and Inclusion strategy at the University of Oxford underscoring the effect of not just the digital divide, but also the gender and geographical divides that exist within and between countries, regions and institutions. Differences in access to technology and digital literacy can exacerbate inequities. Communities without adequate access to the internet or technology may be excluded from participating in or benefiting from data-driven research initiatives.

Professor Evelyn Garwe, Dean at UM6P in Morocco talked about the innovative strategies their University is employing to combat the digital divide and help students in their learning; including providing universal access for all students to state-of-the-art computer and data collection equipment and software.

Experts agreed that we need to embrace the developing technologies. Professor Gita Yadav from the Indian National Institute of Plant Genome Research highlighted the importance of trust and transparency in AI-driven research assessment: “I believe that you are more likely to trust an assessment process if you understand how it works and can access the information about underlying algorithms and the data that go into assessing your work. Transparency can help address potential biases in the assessment process.

We need to open the lines of communication: How are we using AI for research assessment? How can we foster greater acceptance of the technologies that are constantly evolving?”

As the event concluded, it was clear that the work ahead in reforming research practices is significant and urgent. The insights gained from today’s discussions emphasised the need for a concerted effort within the academic community to reevaluate and innovate research assessment practices. With a collective commitment to ethical leadership in data and AI, stakeholders are poised to make impactful changes that resonate across various fields, ultimately benefiting society as a whole.