Supported

This page lists research meetings and individual researchers who have been (or will be) supported by the ELIAS research network programme.

Research Meetings

2016

[Workshop] MediaEval 2016 Multimedia Evaluation Workshop

  • Dates and location : 20-22 October, Amsterdam
  • Convened by: Martha Larson (NL)

[Workshop] Lucene4IRevaluation: Developing IR Evaluation Resources using Lucene

  • Dates and location : 8-9 September 2016, Glasgow, UK
  • Convened by: Leif Azzopardi & Yashar Mosfeghi (UK)

[School] RUSSIR 2016

  • Dates and location : 22 August 2016 – 26 August 2016, Saratov Russia
  • Convened by : Alexander Kotov (US)

[Other Meetings] Crowdsourcing Research – Transcending Disciplinary Boundaries

  • Dates and location : 15-18 August 2016, Dagstuhl, Germany
  • Convened by: Gianluca Demartini (UK)

[Other Meetings] Joint shared task workshop of ACL BioNLP 2016

  • Dates and location : 13 August 2016, Berlin, Germany
  • Convened by: Claire Nédellec (FR)

[Workshop] Task-based Information Interaction Workshop @ SIGIR2016

  • Dates and location : 22 July 2016, Pisa, Italy
  • Convened by: Emine Yilmaz (UK)

[Workshop] Medical Information Retrieval (MedIR) Workshop 2016 @SIGIR2016

  • Dates and location : 21 July 2016, Pisa, Italy
  • Convened by: Lorraine Goeuriot (FR)

[Conference] Spanish conference in Information retrieval (CERI 16)

  • Dates and location : 14-16 June 2016, Granada, Spain
  • Convened by : Information Retrieval Spanish Society – UGR (ES)

[Other Meetings] Evaluating Personal Lifelogs

  • Dates and location : 6 June 2016, Glasgow, UK
  • Convened by: Frank Hopfgartner (UK)

[Other Meetings] Medical Information Retrieval: investigating query behaviour and evaluating reliability and understandability

  • Dates and location : 1 April 2016, Grenoble, FR
  • Convened by: Guido Zuccon (AU)

[Conference] 38th European Conference on Information Retrieval

  • Dates and location : 20 – 23 March 2016, Padua, Italy
  • Convened by : Nicola Ferro (IT)

2015

[Workshop] MediaEval Multimedia Evaluation Workshop

  • Dates and location : 14 – 16 September 2015, Wurzen, Germany
  • Convened by : Martha Larson (NL)

[Other Meetings] Living Labs for Information Retrieval Evaluation (LL4IR) CLEF Lab

  • Dates and location : 9 September 2015, Toulouse, France
  • Convened by : Anne Schuth (NL)

[School] The 10th European Summer School in Information Retrieval, ESSIR 2015

  • Dates and location : 31 August 2015 – 4 September 2015, Thessaloniki, Greece
  • Convened by : Theodora Tsikrika (GR)

[School] The 9th Russian Summer School in Information Retrieval, RuSSIR 2015

  • Dates and location : 24 – 28 August 2015, St. Petersburg, Russia
  • Convened by : Ilya Markov (NL)

[Other Meetings] An Introduction to Click Models – SIGIR 2015 Tutorial

  • Dates and location : 09 – 13 August 2015, Santiago, Chile
  • Convened by : Aleksandr Chuklin (CH)

[Other Meetings] Living Labs For Information Retrieval Evaluation (LL4IR) Challenge

  • Dates and location : 22 May 2015 – 22 May 2018, Amsterdam, The Netherlands
  • Convened by : Anne Schuth (NL)

[Other Meetings] CLEF Lab organisers meeting

  • Dates and location : 29 March – 02 April 2015, Vienna University of Technology
  • Convened by : Marijn Koolen (NL)

[Conference] Student Support for participation at ECIR 2015

  • Dates and location : 29 March – 02 April 2015, Vienna, Austria
  • Convened by : Andreas Rauber (AT)

[Workshop] EaaS: Evaluation-as-a-Service

  • Dates and location : 05 – 06 March 2015, Sierre, Switzerland
  • Convened by : Henning Müller (CH)

2014

[Conference] MediaEval Multimedia Evaluation Workshop

  • Dates and location : 16 – 18 October 2014, Barcelona, Spain
  • Convened by : Martha Larson (NL)

[Workshop] Evaluation for Learning Language Models

  • Dates and location : 15 – 16 October 2014, Stockholm
  • Convened by : Jussi Karlgren (SE)

[School] Information Foraging and Retrieval Autumn School

  • Dates and location : 21 – 26 September 2014, Schloss Dagstuhl, Germany
  • Convened by : Ingo Frommholz (UK)

[Workshop] PAN evaluation lab on uncovering plagiarism, authorship, and social software misuse

  • Dates and location : 15 – 18 September 2014, Sheffield, UK
  • Convened by : Benno Stein (DE)

[Conference] CLEF 2014: Information Access Evaluation meets Multilinguality, Multimodality and Interaction

  • Dates and location : 15 – 18 September 2014, University of Sheffield, UK
  • Convened by : Paul Clough (UK)

[Other Meetings] Conference Tutorial: Evaluating Recommender Systems: Ensuring Replicability of Evaluation

  • Dates and location : 01 – 04 September 2014, Santiago, Chile
  • Convened by : Alan Said (NL)

[Conference] Information Interaction in Context

  • Dates and location : 26 – 30 August 2014, Regensburg
  • Convened by : David Elsweiler (DE)

[Workshop] Gathering Efficient Assessments of Relevance (GEAR)

  • Dates and location : 11 July 2014, Gold Coast, Australia
  • Convened by : Robert Villa (UK)

[Workshop] Living Labs for IR Challenge Workshop

  • Dates and location : 06 June 2014, Amsterdam, The Netherlands
  • Convened by : Krisztian Balog (NO)

[Other Meetings] CLEF Lab Organizers Meeting at ECIR 2014

  • Dates and location : 14 – 16 April 2014, Amsterdam
  • Convened by : Nicola Ferro (IT)

[Conference] ECIR 2014: European Conference on Information Retrieval

  • Dates and location : 13 – 16 April 2014, Amsterdam, The Netherlands
  • Convened by : Maarten de Rijke (NL)

2013

[Workshop] PAN@ FIRE – Cross Language Indian News Story Search

  • Dates and location : 04 – 06 December 2013, New Delhi
  • Convened by : Paolo Rosso (ES)

[Workshop] Living Labs for Information Retrieval Evaluation

  • Dates and location : 01 November 2013, Burlingame, CA, USA
  • Convened by : Krisztian Balog (NO)

[Conference] CLEF: Conference and Labs of the Evaluation Forum

  • Dates and location : 23 – 26 September 2013, Valencia
  • Convened by : Paolo Rosso (ES)

[Other Meetings] Russian Summer School in Information Retrieval

  • Dates and location : 16 – 20 September 2013, Kazan, Russia
  • Convened by : Stefan Rueger (UK)

[School] 9th European Summer School in Information Retrieval

  • Dates and location : 02 – 06 September 2013, Granada, Spain
  • Convened by : Juan M. Fernández-Luna (ES)

[School] EU summers school Information Foraging 2013

  •  Dates and location : 19 – 30 August 2013, Nijmegen, Netherlands
  • Convened by : Wessel Kraaij (NL)

[Exchange Grant] Grant Application for database creation: Relevance assessment for a medical information retrieval task (CLEF eHealth Task 3)

  • 13 May 2013 for 2 weeks
  • Grantee : Lorraine Goeuriot (IE)

[Other Meetings] CLEF 2013 organizers meeting

  • Dates and location : 26 March 2013, ECIR 2013, Moscow
  • Convened by : Maarten de Rijke (NL)

[School] PROMISE winter school: Bridging between Information Retrieval and Databases

  • Dates and location : 23 – 27 January 2012, Zinal, Switzerland
  • Convened by : Henning Müller (CH)

2012

  • PAN@FIRE: Cross-Language !ndian News Story Search (CL!NSS)
    • December 17-18, 2012
    • The aim of this workshop is to create technologies for extraction of parallel and comparable cross-lingual data from the widely available quasi-comparable data e.g. news stories. The organizers created a benchmark corpus from the News seeds and generated the relevance judgments for the automatic evaluation.
  • CLEF 2012: Conference on Multilingual and Multimodal Information Access Evaluation
    • September 17-20, 2012
    • CLEF 2012 consists of an independent peer-reviewed conference on a broad range of issues in the fields of multilingual and multimodal information access evaluation, and a set of labs and workshops designed to test different aspects of mono and cross-language Information retrieval systems.
  • PAN 2012: Evaluation Lab at CLEF 2012
    • September 17, 2012
    • PAN is a networking initiative that centers around the topics of plagiarism, authorship, and social software misuse. PAN features four evaluation tasks (i) Wikipedia quality flaw prediction, (ii) plagiarism detection, (iii) sexual predator identification in chat logs, and (iv) authorship attribution. Altogether, 38 teams submitted runs.
  • EU Summer School: Information Foraging
    • August 27 – September 7, 2012
    • The scientific theme of the summer school is interactive search in all its aspects. A wide range of courses was presented that i) help students to master the different scientific disciplines related to interactive search/browsing behavior, task based search, ii) help to understand the interaction process, iii) introduce the technology required to support effective interactive search (including user interfaces and scalable search algorithms) iv) provide an overview of classic and more recent evaluation methods and metrics.
    • 12 Lecturers and 35 participants
  • CLT seminar: IR workshop series at the University of Gothenburg
    • Spring 2012
    • The Centre for Language Technology organizes an IR workshop series with the objective to raise awareness for IR at the University of Gothenburg and to get students interested in the field of IR in order to sign up for a course in Information Retrieval in the fall of 2012.
    • The following speakers received support to speak at the seminar: Kalervo Järvelin.
  • SWIRL II: Strategic Workshop on Information Retrieval at Lorne
    • February 14 – 17, 2012
    • A gathering of the world’s leading Information Retrieval researchers to examine past achievements in IR research and use that understanding to determine fruitful future directions of the field.
    • The following researchers received support to travel to SWIRL II: Gareth Jones, Julio Gonzalo, Jussi Karlgren, Nicola Ferro, Pia Borlund, Vanessa Murdock, Arjen de Vries, Jaap Kamps, Kalervo Jarvelin, Maarten de Rijke, and Stefano Mizzaro. Local researchers David Hawking, Peter Bruza, Andrew Trotman, and Shlomo Geva also received support from ELIAS.
    • See ‘Outcomes‘ for the results of this meeting.
  • PROMISE winter school on information retrieval and information visualization
    • January 17 – 23, 2012
    • Aims to give participants a grounding in the core topics that constitute the multidisciplinary area of Multilingual Information Retrieval.
    • The following students received support to attend the PROMISE winter school: Fatma Zohra Bessai-Mechmache, Debotosh Bhattacharjee, Rodrigo Calumby, Jorge Camargo, Aline Crédeville, Mochamad Ibrahim, Andre Freitas, Jose Moreno, Siiri Pärkson, Volodymyr Floreskul, Petra Galuscakova, Ali Hosseinzadeh Vahid, Ivana Kacar, Pavel Stranak, and Valentin Mazareanu.

2011

  • CLEF 2011: Conference on Multilingual and Multimodal Information Access Evaluation
    • September 19 – 22, 2011
    • The following students received support to participate in CLEF 2011 in Amsterdam: Pinaki Bhaskar, Tolga Berber, Ilés Solt, Fang Xu, Lefteris Xioufis, Gabriel Oberreuter, Esteban Castillo Juarez, Neil Cooke, Christopher Harris, and Amel Ksibi.

Individual Researchers

2016

  • Serwah Sabetghadam: Crowdsourcing evaluation of multimedia retrieval
    • Dates: 18 August 2016 for 10 days
    • Host: Martha Larson and Maria Eskevich (NL)
  • Juan Manuel Fernández Luna: Evaluating Information Access Systems
    • Dates: 18 April 2016 for 4 weeks
    • Host: Paul Clough (UK)
  • Nawal Ould Amer: Social and Personalized Information Retrieval.
    • Dates: 1 April 2016 for 3 months
    • Host: Jaap Kamps (NL)
  • Aldo Lipani: A Quest on Retrievability Theory
    • Dates : 1 February 2016 for 4 weeks
    • Host : Leif Azzopardi (UK)

2015

  • Sebastian Arnold: Evaluating Entity Recognition As-You-Type
    • Dates : 30 November 2015 for 5 days
    • Hosts : Philippe Cudré-Mauroux and Djellel Difallah (CH)
  • David Maxwell: Users and Searching: Modelling Users with the IPRP and Markov Models
    • Dates : 23 November 2015 for 10 days
    • Host : Norbert Fuhr (DE)
  • Stefano Mizzaro: Crowdsourcing for IR Effectiveness Evaluation
    • Dates : 16 November 2015 for 1 week
    • Host : Gianluca Demartini (UK)
  • Joao Palotti: Readability Evaluation within the Scope of Medical Information Retrieval
    • Dates : 1 November 2015 for 6 weeks
    • Host: Lorraine Goeuriot (FR)
  • Michal Ružicka: Evaluation of Query Results Merging Strategies for Math Information Retrieval
    • Dates : 17 October 2015 for 10 days
    • Host: Davood Rafiei (CA)
  • Aleksandr Beloborodov: Personalized Medical Information Retrieval: using CLEF eHealth IR benchmark to study contextualization of patients’ queries
    • Dates : 28 September 2015 for 8 weeks
    • Host : Goeuriot Domaine (FR)
  • Magnus Sahlgren: Presenting a novel type of evaluation of unsupervised learning techniques at EMNLP 2015
    • Dates : 18 September 2015 for 5 days
    • Host : Lluis Marquez (QA)
  • Frank Hopfgartner: Research Visit to TU Vienna and Tutorial on “Real-Time Recommendation of Streamed Data” at ACM RecSys 2015
    • Dates : 15 September 2015 for 5 days
    • Host : Allan Hanbury (AT)
  • Bogdan Ionescu: Retrieving Diverse Social Images Task
    • Dates : 12 September 2015 for 5 days
    • Host : Martha Larson (NL)
  • Villegas Santamaria Mauricio : Presentation of the results of ImageCLEF 2015 evaluation
    • Dates: 8 September 2015 for 5 days
    • Host : Josiane Mothe (FR)
  • Md Ashraful Amin: Task organization for workshop of ImageCLEF, CLEF 2015
    • Dates : 8 September 2015 for 5 days
    • Host : Müller, Sierre (CH)
  • Alba Garcia: ImageCLEFmed participation 2015
    • Dates: 8 September 2015 for 5 days
    • Host : Josiane Mothe (FR)
  • Andres Duque : Development of resources and evaluation frameworks for multilingual Word Sense Disambiguation in the biomedical search domain
    • Dates : 7 September 2015 for 13 weeks
    • Host : Mark Stevenson (UK)
  • Gianluca Demartini: Crowdsourcing for Information Retrieval Evaluation
    • Dates : 15 June 2015 for 8 days
    • Host(s) : Stefano Mizzaro (IT)
  • Shuaiqiang Wang: Evaluation for Recommender Systems
    • Dates : 15 April 2015 for 4 days
    • Host(s) : Maarten de Rijke (NL)
  • Djellel Eddine Difallah: Measuring Human Behaviour in Search Evaluation Micro Tasks
    • Dates : 07 April 2015 for 10 days
    • Host : Gianluca Demartini (UK)
  • Colin Wilkie: Retrievability in a Recall Oriented Environment.
    • Dates : 06 April 2015 for 4 weeks
    • Host : Andreas Rauber (AT)
  • Michele Catasta: Transactive Search Evaluation
    • Dates : 04 April 2015 for 9 days
    • Host : Gianluca Demartini (UK)
  • Julio Gonzalo: ECIR tutorial on A Formal Approach to Effectiveness Metrics for Information Access: Retrieval, Filtering, and Clustering
    • Dates : 29 March 2015 for 5 days
    • Host : Andreas Rauber (AT)
  • Tuan Vu Tran: Modeling and Evaluating User Interaction in IR
    • Dates : 20 February 2015 for 14 days
    • Host : Leif Azzopardi (UK)
  • Stefano Mizzaro: Formal Properties of Information Retrieval Effectiveness Metrics
    • Dates : 16 February 2015 for 7 days
    • Host : Julio Gonzalo (ES)
  • Evangelos Kanoulas: Formal Properties of Information Retrieval Effectiveness Metrics
    • Dates : 16 February 2015 for 7 days
    • Host : Julio Gonzalo (ES)

2014

  • Michal Ružicka: Maths Information Retrieval Evaluation
    • Dates : 07 December 2014 for 7 days
    • Host(s) : Noriko Kando (JP)
  • Petr Sojka: Evaluation of Math Indexer and Searcher (MIaS) for Math Information Retrieval (MIR)
    • Dates : 07 December 2014 for 7 days
    • Host(s) : Noriko Kando (JP)
  • Paul Clough: CLEF – invited talk and collaboration
    • Dates : 05 December 2014 for 4 days
    • Host(s) : Prasenjit Majumder (IN)
  • Henning Müller: FIRE-CLEF-eHealth
    • Dates : 03 December 2014 for 10 days
    • Host(s) : Prasenjit Majumder (IN)
  • Tomas Tunys: Boosting for Learning to Rank with Query Log Data
    • Dates : 01 November 2014 for 4 weeks
    • Host(s) : Masrour Zoghi (NL)
  • Prasenjit Majumder: CLEF meeting and collaboration with FIRE
    • Dates : 17 September 2014 for 6 days
    • Host(s) : PAUL CLOUGH (UK)
  • Jesus Vilares: Attendance to the CLEF 2014 Conference and Labs of the Evaluation Forum
    • Dates : 15 September 2014 for 5 days
    • Host(s) : Paul Clough (UK)
  • Maria Maistro: Extending Average Precision to Multi-Graded Relevance Judgements
    • Dates : 15 September 2014 for 5 days
    • Host(s) : Paul Clough (UK)
  • Bernardo Cabaleiro Barciela: Methodology and Resources to Evaluate the Recovering of Implicit Predicates
    • Dates : 04 August 2014 for 4 weeks
    • Host(s) : Suresh Manandhar (UK)
  • Yerai Doval Mosquera: 3rd MUMIA Training School on Information Retrieval and Interactive Information Access
    • Dates : 20 July 2014 for 6 days
    • Host(s) : Yannis Tzitzikas (GR)
  • Nicola Ferro: Book on Reliability and Validity in IR Evaluation
    • Dates : 30 June 2014 for 3 days
    • Host(s) : Christina Lioma (DK)
  • Anne Schuth: Online Evaluation for Online Learning to Rank
    • Dates : 01 February 2014 for 5 weeks
    • Host(s) : Pavel Serdyukov (RU)

2013

  • Francisco J. Valverde-Albacete: Towards the Evaluation of FCA-enhanced Semantic Models of Language by Information-Theoretic Means
    • Dates : 17 July 2013 for 5 weeks
    • Host(s) : Alessandro Moschitti (IT)
  • Martin Líška: Mathematics Information Retrieval
    • Dates : 18 June 2013 for 7 days
    • Host(s) : Noriko Kando (JP)
  • Petr Sojka: Math Information Retrieval Evaluation
    • Dates : 17 June 2013 for 7 days
    • Host(s) : Noriko Kando (JP)
  • Frank Pollick: Methodologies for analysing neurospatial activation patterns associated with information retrieval tasks conducted on search engines
    • Dates: 31 May 2013 for 5 days
    • Host(s) : Rene Reidl (AT)
  • Maria-Hendrike Peetz: What is reputation polarity?
    • Dates : 04 March 2013 for 15 days
    • Host(s) : Julio Gonzalo (ES)

2012

  • Kalervo Järvelin and Evangelos Kanoulas: Evaluating Information Access Systems
    • October 2012
    • The purpose of the visit was to participate in the NII Shonan Meeting on Whole-Session Evaluation of Interactive Information Retrieval Systems. The working groups were about detecting session types, statistical modeling of whole sessions, needs for whole session evaluation, ideal session evaluation, task characterization, and sharing of methods and materials.
  • Burak Acar: Content Based Case Retrieval in Medicine
    • September 2012
    • Hosted by Henning Müller (University of Applied Sciences Western Switzerland)
    • The aim of this visit was to work on defining a new Content Based Liver Case Retrieval (CBCR-Liver) task within a specialized and structured database of past cases. A task proposition to the CLEF community was presented as a result of this work.
  • Anne Schuth: News recommendation in a living lab.
    • April 2012
    • Hosted by Gianmarco De Francisci Morales (Yahoo! Research Lab, Barcelona)
    • The aim of the visit is to run a set of news recommendation experiments on private browser toolbar data using the learning to rank framework. On top of this, the experiments will be conducted in an online setting, resulting in a series of new research questions and research opportunities.
  • Bart Thomee: Creation of an annotated photo database.
    • April 2012
    • This project aims to create a database (using crowdsourcing) with annotated photos, which will be used in the photo annotation task of ImageCLEF. The photos are annotated with challenging, high-level concepts related to, for example, the weather, lighting effects, and photography style.
  • Theodora Tsikrika: Assessing the scholarly impact of evaluation campaigns.
    • February 2012
    • Hosted by Birger Larsen (Royal School of Library and Information Science, Copenhagen).
    • The aim of this visit is to work towards methodologies that measure the scholarly impact of evaluation campaigns, not only those based on the traditional system-oriented evaluation paradigm, but also those that will be based on the new evaluation paradigm introduced by ELIAS.
  • Damiano Spina: A corpus for evaluating opinion-based entity profiling on microblog streams.
    • February 2012
    • Hosted by Maarten de Rijke (University of Amsterdam).
    • The aim of the visit is to collaborate on the definition, design and development of a corpus that will include manually annotated tweets to evaluate opinion-based profiling of an entity in a microblog stream. Opinion-based profiling includes extracting those concepts and entities that occur as targets of opinions in a stream of microblog posts relevant to the given entity.
    • See ‘Outcomes‘ for the results of this visit.