The SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR) aims to provide a venue for publication and discussion of research focused on the repeatability, reproducibility, and generalizability of previously published methods and results. In addition, the workshop will include an invited track where submissions will report on a common set of experiments using different open-sourced implementations of well-established baselines. The goal is to further understand any differences in effectiveness and efficiency from different baseline implementations.
More info at https://sites.google.com/site/sigirrigor/
Jaime Arguello is an Assistant Professor in the School of Information and Library Science (SILS) at the University of North Carolina at Chapel Hill. He has a Ph.D. in Computer Science from Carnegie Mellon University. His dissertation research focused on aggregated search prediction and evaluation. At SILS, his current research focuses on understanding and modeling cross-component effects in aggregated search and on developing and evaluating interactive tools for search assistance. Dr. Arguello is a recipient of the SIGIR 2009 Best Paper Award and the ECIR 2011 Best Student Paper Award. At SILS, he received the 2014 Deborah Barreau Award for Teaching Excellence and is a recent recipient of the NSF Early Career Award. Dr. Arguello was co-organizer of the 2013 SIGIR Doctoral Consortium.
Fernando Diaz is a senior researcher at Microsoft Research and a founding member of the MSR-NYC lab. Prior to joining Microsoft, Fernando was a senior scientist at Yahoo Research. His primary research interest is formal information retrieval models and his research experience includes distributed information retrieval approaches to web search, interaction logging and modeling, interactive and faceted retrieval, mining of temporal patterns from news and query logs, cross-lingual information retrieval, graph-based retrieval methods, and synthesizing information from multiple corpora. He received a B.Sc. in Computer Science and a B.A. in Political Science, both from the University of Michigan, and a Ph.D. from the University of Massachusetts Amherst. His work on federation won the best paper awards at the WSDM 2009, SIGIR 2009, and ECIR 2011 conferences. His work on crisis informatics has received awards at SIGIR 2011 and ISCRAM 2013. He is a co-organizer of the Temporal Summarization track and Web track at TREC 2013-2015 and WSDM 2014.
Jimmy Lin an Associate Professor in the College of Information Studies (The iSchool) at the University of Maryland, with a joint appointment in the Institute for Advanced Computer Studies (UMIACS) and an affiliate appointment in the Department of Computer Science. He graduated with a Ph.D. in Electrical Engineering and Computer Science from MIT in 2004. Lin's research lies at the intersection of information retrieval and natural language processing; his current work focuses on large-scale distributed algorithms and infrastructure for data analytics. Relevant organization experience includes IR PC chair for CIKM 2009, PC co-chair for 2014 IEEE Big Data 2014, and numerous tracks at TREC (HARD, question answering, and most recently, the microblog tracks).
Andrew Trotman gained a BA in the 1980s, an MSc in the 1990s and a PhD in the 2000s, all in Computer Science, and all from the University of Otago. Between degrees he worked as a software engineer in Computer Animation and later in Information Retrieval. He was involved in the organization of INEX from 2004-2010. Initially participating in the organization of the ad hoc track (2004, 2005), he then went on to co-chair a track (2006), and to then co-chair INEX (2007-2010). He also co-chaired the mid-year INEX workshop in Glasgow in 2005. His involvement in the organization of the SIGIR conferences started with reviewing, but moved on to co-chaired SIGIR workshops (2006-2009, 2012) and the SIGIR Doctoral Consortium (2008, 2009); he has been an area chair several times. He was the elected SIGIR Executive secretary (2010-2012), and a general co-chair of SIGIR 2014 in Gold Coast, Australia. He is also the primary author and technical lead of the ATIRE open source search engine.