Publications
2022
Ombretta Strafforello, Vanathi Rajasekart, Osman S Kayhan, Oana Inel, Jan van Gemert: Humans disagree with the IoU for measuring object detector localization error
Alessandro Piscopo, Oana Inel, Sanne Vrijenhoek, Martijn Millecamp, Krisztian Balog: QUARE: 1st Workshop on Measuring the Quality of Explanations in Recommender Systems
Cataldo Musto, Amra Delic, Oana Inel, Marco Polignano, Amon Rapp, Giovanni Semeraro, Jürgen Ziegler: Workshop on Explainable User Models and Personalised Systems (ExUM)
Oana Inel, Lora Aroyo: Fine-tuning machine confidence with human relevance for video discovery
Vincent Robbemond, Oana Inel, Ujwal Gadiraju: Understanding the Role of Explanation Modality in AI-assisted Decision-making
Cataldo Musto, Amra Delic, Oana Inel, Marco Polignano, Amon Rapp, Giovanni Semeraro, Jürgen Ziegler: Workshop on Explainable User Models and Personalised Systems (ExUM) . Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization, 2022
Tim Draws, Oana Inel, Nava Tintarev, Christian Baden, Benjamin Timmermans: Comprehensive Viewpoint Representations for a Deeper Understanding of User Interactions With Debated Topics Best Paper Award
Oana Inel: Understanding Events: A Diversity-driven Human-Machine Approach. PhD Thesis , 2022.
2021
Oana Inel, Tomislav Duricic, Harmanpreet Kaur, Elisabeth Lex, and Nava Tintarev: Design Implications for Explanations: A Case Study on Supporting Reflective Assessment of Potentially Misleading Videos. AI for Human Learning and Behavior Change, a section of the journal Frontiers in Artificial Intelligence , 2021.
Tim Draws, Alisa Rieger, Oana Inel, Ujwal Gadiraju, and Nava Tintarev: A Checklist to Combat Cognitive Biases in Crowdsourcing. In the Proceedings of the 9th AAAI Conference on Human Computation and Crowdsourcing (HCOMP) , 2021. Best Paper Award
Shabnam Najafian, Tim Draws, Oana Inel, Alisa Rieger, Francesco Barile, Rishav Hada, and Nava Tintarev: Toward Benchmarking Group Explanations: Evaluating the Effect of Aggregation Strategies versus Explanation. In the Proceedings of the Perspectives on the Evaluation of Recommender Systems Workshop, collocated with the ACM Recommender Systems Conference , 2021.
Mats Mulder, Oana Inel, Jasper Oosterman, Nava Tintarev: Operationalizing Framing to Support Multiperspective Recommendations of Opinion Pieces In the proceedings of the Conference on Fairness, Accountability, and Transparency (FAccT '21) , 2021
2020
Ørting, S. N., Doyle, A., van Hilten, A., Hirth, M., Inel, O., Madan, C. R., Mavridis, P., Spiers, H., & Cheplygina, V.: A Survey of Crowdsourcing in Medical Image Analysis Human Computation , 7(1), 1-26.
Shabnam Najafian, Daniel Herzog, Sihang Qiu, Oana Inel, Nava Tintarev: You Do Not Decide for Me! Evaluating Explainable Group Aggregation Strategies for Tourism In the proceedings of the 31st ACM Conference on Hypertext and Social Media
Oana Inel, Nava Tintarev and Lora Aroyo: Eliciting User Preferences for Personalized Explanations for Video Summaries In the proceedings of the 28th Conference on User Modeling, Adaptation and Personalization, 2020
Shabnam Najafian, Oana Inel and Nava Tintarev: Someone really wanted that song but it was not me!: Evaluating Which Information to Disclose in Explanations for Group Recommendations IUI '20: Proceedings of the 25th International Conference on Intelligent User Interfaces Companion, 2020
2019
2018
Oana Inel, Giannis Haralabopoulos, Dan Li, Christophe Van Gysel, Zoltán Szlávik, Elena Simperl, Evangelos Kanoulas, Lora Aroyo: Studying Topical Relevance with Evidence-based Crowdsourcing Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM ), 2018 .
Tommaso Caselli, Oana Inel: Crowdsourcing StoryLines: Harnessing the Crowd for Causal Relation Annotation Proceedings of the Workshop Events and Stories in the News 2018
Anca Dumitrache, Oana Inel, Lora Aroyo, Benjamin Timmermans, Chris Welty: CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement
Oana Inel, Sabrina Sauer and Lora Aroyo: A Study of Narrative Creation by Means of Crowds and Niches. The sixth AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2018 ) . [Poster] [Pitch Slide]
Roeland Ordelman, Carlos Martinez-Ortiz, Liliana Melgar Estrada, Marijn Koolen, Jaap Blom, Willem Melder, Jasmijn van Gorp, Victor de Boer, Themistoklis Karavellas, Lora Aroyo, Thomas Poell, Norah Karrouche, Eva Baaren, Johannes Wassenaar, Julia Noordegraaf, Oana Inel: Challenges in Enabling Mixed Media Scholarly Research with Multi-media Data in a Sustainable Infrastructure Digital Humanities (DH 2018 )
Chantal van Son, Oana Inel, Roser Morante, Lora Aroyo and Piek Vossen: Resource Interoperability for Sustainable Benchmarking: The Case of Events 11th edition of the Language Resources and Evaluation Conference (LREC 2018 )
2017
Victor de Boer, Liliana Melgar, Oana Inel, Carlos Martinez Ortiz, Lora Aroyo and Johan Oomen: Enriching Media Collections for Event-based Exploration International Conference of Metadata and Semantics Research (MTSR 2017) Springer Communications in Computer and Information Science. Springer. Best Paper Award
Carlos Martinez-Ortiz, Roeland Ordelman, Marijn Koolen, Julia Noordegraaf, Liliana Melgar, Lora Aroyo, Jaap Blom, Victor de Boer, Willem Melder, Jasmijn van Gorp, Eva Baaren, Kaspar Beelen, Norah Karrouche, Oana Inel, Rosita Kiewik, Themis Karavellas and Thomas Poell. From Tools to “Recipes”: Building a Media Suite within the Dutch Digital Humanities Infrastructure CLARIAH. Paper presented at the Digital Humanities Benelux Conference 2017.
Victor de Boer, Oana Inel, Lora Aroyo, Chiel van den Akker, Susane Legene, Carlos Martinez, Werner Helmich, Berber Hagendoorn, Sabrina Sauer, Jaap Blom, Liliana Melgar, Johan Oomen. DIVE+: Explorative Search for Digital Humanities Winner of the Grand Prize
Oana Inel, Lora Aroyo, Jaap Blom, Victor de Boer, Werner Helmich, Liliana Melgar, Carlos Martinez Ortiz, Johan Oomen: DIVE+: Explorative Search in Integrated Linked Media ICT Open 2017, Meet the Demo
Oana Inel, Lora Aroyo, Jaap Blom, Victor de Boer, Werner Helmich, Liliana Melgar, Carlos Martinez Ortiz, Johan Oomen: DIVE+: Explorative Search for Digital Humanities in CLARIAH Media Suite ICT Open 2017, SIKS Track
Oana Inel and Lora Aroyo: Harnessing Diversity in Crowds and Machines for Better NER Performance Research Track at ESWC 2017 .
Robert Iepsma, Theo Gevers, Oana Inel, Lora Aroyo, Robert-Jan Sips and Zoltan Szlavik: Crowdsourcing for Video Event Detection Collective Intelligence 2017
Oana Inel and Lora Aroyo: Improving NER with Diversity in Machines and Crowds Collective Intelligence 2017
Anca Dumitrache, Oana Inel, Benjamin Timmermans and Lora Aroyo: Crowdsourcing Ambiguity-Aware Ground Truth Collective Intelligence 2017
2016
Zhaochun Ren, Oana Inel, Lora Aroyo, Maarten de Rijke: Time-aware Multi-Viewpoint Summarization of Multilingual Social Text Streams CIKM 2016: 25th ACM Conference on Information and Knowledge Management .
Oana Inel: Machine-Crowd Annotation Workflow for Event Understanding Across Collections and Domains PhD Symposium at ESWC 2016 .
Oana Inel, Tommaso Caselli and Lora Aroyo: Crowdsourcing Salient Information from News and Tweets LREC 2016
Tommaso Caselli, Rachele Sprugnoli and Oana Inel: Temporal Information Annotation: Crowd vs. Experts LREC 2016
Oana Inel, Lora Aroyo, Victor de Boer, Annemarie Collijn, Werner Helmich, Christiaan Meijer, Johan Oomen, Elco van Staveren: DIVEplus: Browser for Integrated Linked Media ICT Open 2016, Meet the Demo
Oana Inel, Lora Aroyo, Victor de Boer, Annemarie Collijn, Werner Helmich, Christiaan Meijer, Johan Oomen, Elco van Staveren: From DIVE to DIVEplus: Exploring Integrated Linked Media ICT Open 2016, SIKS Track
Anca Dumitrache, Oana Inel, Benjamin Timmermans, Lora Aroyo, Robert-Jan Sips and Chris Welty: CrowdTruth: Methodology for Harnessing Disagreement in Gathering Annotated Data. ICT Open 2016
2015
Anca Dumitrache, Oana Inel, Benjamin Timmermans, Lora Aroyo and Robert-Jan Sips: CrowdTruth: Machine-Human Computation Framework for Harnessing Disagreement in Gathering Annotated Data
Carlos Martinez-Ortiz, Lora Aroyo, Oana Inel, Stavros Champilomatis, Anca Dumitrache and Benjamin Timmermans: Provenance-driven Representation of Crowdsourcing Data for Efficient Data Analysis
Victor de Boer , Johan Oomen , Oana Inel, Lora Aroyo , Elco van Staveren, Werner Helmich and Dennis de Beurs. 2014. DIVE into the Event-Based Browsing of Linked Historical Media Journal of Web Semantics , 2015 (preprint).
2014
Oana Inel, Khalid Khamkham, Tatiana Cristea, Arne Rutjes, Jelle van der Ploeg, Lora Aroyo, Robert-Jan Sips, Anca Dumitrache and Lukasz Romaszko: Crowd Truth: Machine-Human Computation Framework for Harnessing Disagreement in Gathering Annotated Data ISWC-RBDS 2014 .
Victor de Boer , Johan Oomen , Oana Inel, Lora Aroyo , Elco van Staveren, Werner Helmich and Dennis de Beurs. 2014. DIVE into the Event-Based Browsing of Linked Historical Media Proceedings of the Semantic Web Challenge 2014 . ISWC 2014 3rd place
2013
Oana Inel, Lora Aroyo, Chris Welty, Robert-Jan Sips: Domain-independent quality measures for Crowd Truth Disagreement.
Oana Inel, Lora Aroyo, Chris Welty, Robert-Jan Sips: Exploiting crowdsourcing disagreement with various domain-independent quality measures DeRiVe 2013 .
Guillermo Soberon, Lora Aroyo, Chris Welty, Oana Inel, Manfred Overmeen, Hui Lin: Content and Behaviour Based Metrics for Crowd Truth CrowdSem 2013 : 45 – 58.