Mark D. Smucker
Home
Publications
Curriculum Vitae
Software
Notes
 
 
 

Alternate views of my publications are available on Google Scholar, the ACM Digital Library, and DBLP.

2015-present

Until I get around to updating this page, publications can be found via google scholar above.

2014

Charles L. A. Clarke and Mark D. Smucker, "Time Well Spent," IIiX 2014, 10 pages. [PDF]

Aiman L. Al-Harbi and Mark D. Smucker, "A Qualitative Exploration of Secondary Assessor Relevance Judging Behavior," IIiX 2014, 10 pages. [PDF]

Gaurav M. Baruah, Adam Roegiest, and Mark D. Smucker, "The Effect of Expanding Relevance Judgements with Duplicates," SIGIR 2014, 4 pages. [PDF]

Mark D. Smucker, Xiaoyu Sunny Guo, and Andrew Toulis, "Mouse Movement During Relevance Judging: Implications for Determining User Attention," SIGIR 2014, 4 pages. [PDF]

Mark D. Smucker, Gabriella Kazai, and Matthew Lease, "Overview of the TREC 2013 Crowdsourcing Track," TREC 2013, 9 pages. [PDF]

Le Li and Mark D. Smucker, "Tolerance of Effectiveness Measures to Relevance Judging Errors," ECIR 2014, pp. 148-159. [PDF]

2013

Charles L.A. Clarke, Luanne Freund, Mark D. Smucker, and Emine Yilmaz, "Report on the SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation (MUBE 2013)," SIGIR Forum 47, 2 (January 2013), pp. 84-95. DOI=10.1145/2568388.2568403. [PDF]

Robert Capra, Luanne Freund, Catherine L. Smith, Mark D. Smucker, and Ryen W. White, "HCIR 2013: the seventh international symposium on human-computer interaction and information retrieval," SIGIR Forum 47, 2 (January 2013), 33-40. DOI=10.1145/2568388.2568394

Krisztian Balog, David Elsweiler, Evangelos Kanoulas, Liadh Kelly, and Mark D. Smucker, "CIKM 2013 workshop on living labs for information retrieval evaluation." In CIKM 2013, pp. 2557-2558. DOI=10.1145/2505515.2505815

Aiman L. Al-Harbi and Mark D. Smucker, "User Expressions of Relevance Judgment Certainty", HCIR 2013, 4 pages. [PDF]

Charles L. A. Clarke, Luanne Freund, Mark D. Smucker, and Emine Yilmaz (editors), "Proceedings of the SIGIR 2013 Workshop on Modeling User Behavior for Information Retrieval Evaluation (MUBE 2013)," 2013. [PDF]

Charles L. A. Clarke, Luanne Freund, Mark D. Smucker, and Emine Yilmaz, "SIGIR 2013 Workshop on Modeling User Behavior for Information Retrieval Evaluation," In the Proceedings of the 36th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, 2013, Dublin, Ireland, 1 page. [PDF]

P. Robert Duimering, Samir Elhedhli, Beth Jewkes, Mark D. Smucker, "Management Engineering: The Engineering of Management Systems," Report prepared for Engineers Canada, Department of Management Sciences, University of Waterloo, January 2013, 21 pages.[PDF]

Mark D. Smucker, Gabriella Kazai, and Matthew Lease, "Overview of the TREC 2012 Crowdsourcing Track," TREC 2012, 9 pages. [PDF]

2012

Mark D. Smucker and Charles L. A. Clarke. "Modeling User Variance in Time-Biased Gain," In the Proceedings of the Sixth Symposium on Human-Computer Interaction and Information Retrieval (HCIR'12), 2012, 10 pages. [PDF]

Mark D. Smucker and Charles L. A. Clarke. "Stochastic Simulation of Time-Biased Gain," In the Proceedings of CIKM, 2012, 5 pages. [PDF]

Mark D. Smucker and Charles L. A. Clarke. "The fault, dear researchers, is not in Cranfield, But in our metrics, that they are unrealistic." In the Proceedings of EuroHCIR, August 2012, Nijmegen, The Netherlands. 2 pages. [PDF]

Mark D. Smucker and Charles L. A. Clarke. "Time-Based Calibration of Effectiveness Measures," In the Proceedings of the 35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, August 2012, Portland, OR, USA. 10 pages. [PDF]

Mark D. Smucker and Chandra Prakash Jethani. "Time to Judge Relevance as an Indicator of Assessor Error," In the Proceedings of the 35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, August 2012, Portland, OR, USA. 2 pages. [PDF]

Mark D. Smucker, James Allan, and Blagovest Dachev. Human Question Answering Performance Using an Interactive Document Retrieval System. In Proceeding of the Fourth Symposium on Information Interaction in Context (IIiX 2012), ACM, 2012. [PDF]

Mark D. Smucker. "Crowdsourcing with a Crowd of One and Other TREC 2011 Crowdsourcing and Web Track Experiments," TREC 2011, 4 pages. [PDF]

2011

Mark D. Smucker. "An Analysis of User Strategies for Examining and Processing Ranked Lists of Documents," In the Proceedings of the Fifth Workshop on Human-Computer Interaction and Information Retrieval (HCIR'11), October 20, 2011, Mountain View, CA, USA. 4 pages. [PDF]

Mark D. Smucker and Chandra Prakash Jethani. "The Crowd vs. the Lab: A Comparison of Crowd-Sourced and University Laboratory Participant Behavior," In the Proceedings of the SIGIR 2011 Workshop on Crowdsourcing for Information Retrieval, July 2011, Beijing, China. 6 pages. [PDF]

Mark D. Smucker, Charles L. A. Clarke, Gordon V. Cormack, and Olga Vechtomova. "University of Waterloo at TREC 2010: Legal Interactive," In the Online Proceedings of TREC 2010. [PDF]

Mark D. Smucker. "Information Representation," Chapter 9 of Interactive Information Seeking, Behaviour and Retrieval, Editors: Ian Ruthven and Diane Kelly, Facet Publishing, 2011. [Publisher's information.]

Mark D. Smucker and Chandra Prakash Jethani. "Measuring Assessor Accuracy: A Comparison of NIST Assessors and User Study Participants," In the Proceedings of the 34th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, July 2011, Beijing, China. 2 pages. [PDF]

Gordon V. Cormack, Mark D. Smucker, and Charles L. A. Clarke. "Efficient and effective spam filtering and re-ranking for large web datasets," Information Retrieval, Springer, 2011, pp. 1-25. [DOI, arXiv Preprint]

2010

Leif Azzopardi, Kalervo Jarvelin, Jaap Kamps, and Mark D. Smucker. "Report on the SIGIR 2010 Workshop on the Simulation of Interaction," SIGIR Forum, Volume 44, December 2010, pages 35-47. http://dx.doi.org/10.1145/1924475.1924484

Mark D. Smucker and Chandra Prakash Jethani. "Impact of Retrieval Precision on Perceived Difficulty and Other User Measures," In the Proceedings of the Fourth Workshop on Human-Computer Interaction and Information Retrieval (HCIR'10), August 22, 2010, New Brunswick, NJ, USA. 4 pages. [PDF]

Leif Azzopardi, Kalervo Jarvelin, Jaap Kamps, and Mark D. Smucker (editors), Proceedings of the SIGIR 2010 Workshop on the Simulation of Interaction: Automated Evaluation of Interactive IR, July 23, 2010, Geneva, Switzerland. [PDF]

Chandra Prakash Jethani and Mark D. Smucker. "Modeling the Time to Judge Document Relevance," In the Proceedings of the SIGIR'10 Workshop on the Simulation of Interaction, July 23, 2010, Geneva, Switzerland. [PDF]

Mark D. Smucker and Chandra Prakash Jethani. "Human Performance and Retrieval Precision Revisited," In the Proceedings of the 33rd Annual ACM SIGIR Conference on Research and Development in Information Retrieval, July 2010, Geneva, Switzerland. [PDF]

2009

Mark D. Smucker, Charles L. A. Clarke, and Gordon V. Cormack. "Experiments with ClueWeb09: Relevance Feedback and Web Tracks," In the Online Proceedings of TREC 2009. [PDF]

Mark D. Smucker. "Towards Timed Predictions of Human Performance for Interactive Information Retrieval Evaluation," In the Proceedings of the Third Workshop on Human-Computer Interaction and Information Retrieval (HCIR'09), October 23, 2009, Washington DC. 4 pages. [PDF]

Mark D. Smucker. "A Plan for Making Information Retrieval Evaluation Synonymous with Human Performance Prediction," In the Proceedings of the SIGIR Workshop on the Future of IR Evaluation, July 23, 2009, Boston. 2 pages. [PDF]

Mark D. Smucker, James Allan. "A New Measure of the Cluster Hypothesis," In the Proceedings of the 2nd International Conference on the Theory of Information Retrieval (ICTIR'09), September 2009, Cambridge, UK. [PDF]

Mark D. Smucker, James Allan, Ben Carterette. "Agreement Among Statistical Significance Tests for Information Retrieval Evaluation at Varying Sample Sizes," In the Proceedings of the 32nd Annual ACM SIGIR Conference on Research and Development in Information Retrieval, July 2009, Boston, Massachusetts, USA. [PDF]

2008

Rebecca Reznik-Zellen, Bob Stevens, Michael Thorn, Jeff Morse, Mark D. Smucker, James Allan, David Mimno, Andrew McCallum, Mark Tuominen. "InterNano: e-Science for the Nanomanufacturing Community," In Proceedings of the 4th IEEE International Conference on e-Science, 2008. [PDF]

Mark D. Smucker. "Evaluation of Find-Similar with Simulation and Network Analysis," Ph.D. Thesis, University of Massachusetts Amherst, September 2008. [PDF]

Jimmy Lin and Mark D. Smucker, "How Do Users Find Things with PubMed? Towards Automatic Utility Evaluation with User Simulations", In the Proceedings of the 31st Annual ACM SIGIR Conference on Research and Development in Information Retrieval, July 2008, Singapore, pages 19-26. [PDF]

2007

Mark D. Smucker, James Allan, and Blagovest Dachev. "UMass Complex Interactive Question Answering (ciQA) 2007: Human Performance as Question Answerers," TREC 2007. [PDF]

Mark D. Smucker. "Work in Progress: Navigating Document Networks," HCIR'07 Workshop on Human-Computer Interaction and Information Retrieval, October 23, 2007, Cambridge, Massachusetts. [PDF]

Mark D. Smucker, James Allan, and Ben Carterette. "A Comparison of Statistical Significance Tests for Information Retrieval Evaluation," CIKM '07, Lisboa, Portugal, 2007. [PDF]

Ben Carterette and Mark D. Smucker. "Hypothesis Testing with Incomplete Relevance Judgments," CIKM '07, Lisboa, Portugal, 2007. [PDF]

Mark D. Smucker and James Allan. "Measuring the Navigability of Document Networks," SIGIR '07 Web Information-Seeking and Interaction Workshop, Amsterdam, The Netherlands, 2007. [PDF]

Mark D. Smucker and James Allan. "Using Similarity Links as Shortcuts to Relevant Web Pages," SIGIR '07, Amsterdam, The Netherlands, 2007. [PDF]

2006

Mark D. Smucker and James Allan. "An Investigation of Dirichlet Prior Smoothing's Performance Advantage," University of Massachusetts, Amherst, CIIR Technical Report IR-548, November 14, 2006. Revised December 13, 2007. [PDF]

Mark D. Smucker. "UMass Genomics 2006: Query-Biased Pseudo Relevance Feedback," TREC, 2006. [PDF]

Mark D. Smucker and James Allan. "Find-Similar: Similarity Browsing as a Search Tool," SIGIR, 2006. [PDF]

Mark D. Smucker and James Allan. "Lightening the Load of Document Smoothing for Better Language Modeling Retrieval," SIGIR, 2006. [PDF]

2005

Mark D. Smucker, David Kulp, and James Allan. "Dirichlet Mixtures for Query Estimation in Information Retrieval," University of Massachusetts, Amherst, CIIR Technical Report 445, April 2005. [PDF]

Mark D. Smucker and James Allan. "An Investigation of Dirichlet Prior Smoothing's Performance Advantage," University of Massachusetts, Amherst, CIIR Technical Report 391, January 2005. [PDF]

Fernando Diaz, Mark D. Smucker, and James Allan. "High Precision Retrieval via User Interaction and Metadata," University of Massachusetts, Amherst, CIIR Technical Report 390, January 2005.

2004

N. Abdul-Jaleel, J. Allan, W.B. Croft, F. Diaz, L. Larkey, X. Li, M.D. Smucker, C. Wade, "UMass at TREC 2004: Novelty and HARD," TREC-13, 2004. [PDF]

Before 2004

Dan Ashlock, Mark D. Smucker, and John Walker. "Graph Based Genetic Algorithms," Proceedings of the 1999 Congress on Evolutionary Computation, pp. 1362-1368. [PDF]

Dan Ashlock, Mark D. Smucker, E. Ann Stanley, and Leigh Tesfatsion. "Preferential Partner Selection in an Evolutionary Study of Prisoner's Dilemma," BioSystems, Vol. 37, No 1-2, 1996, pp. 99-125. [PDF, PS]

E. Ann Stanley, Dan Ashlock, and Mark D. Smucker. "Iterated Prisoner's Dilemma with Choice and Refusal of Partners: Evolutionary Results," Advances in Artificial Life: Third European Conference on Artificial Life, Lecture Notes in Artificial Intelligence, Springer-Verlag, 1995. [PDF, PS]

Mark D. Smucker, E. Ann Stanley, and Dan Ashlock. "Analyzing Social Network Structures in the Iterated Prisoner's Dilemma with Choice and Refusal," University of Wisconsin-Madison Computer Sciences Tech Report CS-TR-94-1259, 37 pp., December 1994. Revised August 1995. [PDF, PS]