Details

Online-Workshop “Tools – Indicators – Metrics: Data Quality in Computational Social Science”

Zeitraum: 14:00 – 18:00
Organizer: GESIS – Leibniz Institute for the Social Sciences, KODAQS
Location: Online
.ics / iCalendar: Download calendar file

A two-day online workshop with sessions focused on tools, indicators, and metrics for assessing the quality of digital behavioral data.

Keynote speaker

Christo Wilson
(Khoury College of Computer Sciences, Northeastern University)

Valerie Hase
(Department of Media and Communication, LMU Munich)

 
Workshop format

The workshop will consist of input presentations, discussions, collaborative breakout sessions, and presentations of existing tools or workflows that help to assess data quality in the field of CSS. We also encourage interactive demonstrations of tools, software, or platforms developed by participants.

Online participation will be available for everyone interested. There is no participation fee.

Program

Day 1 (11.12.2024)

14:00 – 14:10

Welcome and introduction

Yannik Peters, Katrin Weller

14:10 – 14:30

The KODAQS project – Assessing Data Quality in the Social Sciences

Jessica Daikeler, Yannik Peters

14:30 – 15:15

Keynote I: From Awareness to Action: Defining, Assessing & Improving the Quality of Digital Trace Data

Valerie Hase

15:15 – 15:30

Break

 

15:30 – 16:15

Working Session I: Measuring data quality: Do we need standard indicators?

Breakout sessions

16:15 – 16:45

Selected Case Study I:

CARING: Enhancing Open Data Quality through Community Engagement

Christopher Klamm,

Ruben Bach,

Tornike Tsereteli

16:45 – 17:15

Selected Case Study II:

Assessing the Quality of Legislative Text Data

Jan Schwalbach, Lukas Hetzer

 

 

Day 2 (12.12.2024)

14:00 – 14:10

Welcome

Yannik Peters, Katrin Weller

14:10 – 15:00

Working Session II: Potential tools and workflows for data quality assessment

Breakout sessions

15:00 – 15:45

Keynote II: Assessing Data Quality in Practice: A First Look at Trace Data from the National Internet Observatory

Christo Wilson

15:45 – 16:00

Break

 

16:00 – 16:30

Selected Case Study III:

Building a Framework to Detect Ambiguous

Instances in Subjective Tasks: A Case Study on

Sexism Dataset

Aditi Dutta, Rabiraj Bandyopadhyay

16:30 – 16:45

Closing

Yannik Peters, Katrin Weller

Call for submissions

The GESIS – Leibniz Institute for the Social Sciences is pleased to invite submissions for our upcoming workshop on "Tools – Indicators – Metrics: Data Quality in Computational Social Science". The workshop is organized within the KODAQS project, a data quality competence center for the social sciences, which is funded by the Federal Ministry of Education and Research of Germany. As the volume and importance of digital data continue to grow, ensuring its quality has become a critical challenge for researchers and practitioners alike. This workshop aims to bring together experts from various fields to discuss, share, and develop innovative tools, indicators, and methodologies for assessing the quality of digital data.

As part of the KODAQS competence center on data quality, we are building a platform to share tools for data quality assessment. This workshop will help to discuss already existing tools and the need for new tools and workflows that contribute to measuring and enhancing data quality. We invite contributions that focus on, but are not limited to, the following topics:

  • Case studies demonstrating the application of quality assessment tools
  • Methodological approaches and indicators to define and measure digital data quality
  • Challenges in assessing the quality of large-scale digital datasets
  • Comparative studies of existing digital data quality assessment tools
  • Digital data quality tools implementing different types of digital data (e.g. text data, visual data, sensor data etc.)
  • The role of digital data quality in reproducibility and transparency of research
  • Integration of digital data quality assessment in research workflows

We anticipate a highly interactive and engaging event, that will be of mutual benefit to all participants.

Submission process:

We welcome submissions of abstracts (300 words) that provide an overview of the tool, indicator or methodology, its application, and the insights gained. We also invite work in progress.

  • Submission Deadline: November 10, 2024
  • Notification of Acceptance: November 15, 2024

Please submit your abstracts to yannik.peters(at)gesis(dot)org as a PDF document by the deadline mentioned above. All submissions will be peer-reviewed by the workshop's scientific committee.

Workshop organization:

Yannik Peters & Katrin Weller
Contact persons For any questions regarding the workshop or the submission process, please contact Yannik Peters (yannik.peters(at)gesis(dot)org) or Katrin Weller (katrin.weller(at)gesis(dot)org).