Subscribe to the DIRECT System
User not logged into Direct - Friday 19 April 2024
Publications About DIRECT

Publications

International Book Chapters

2009

  • Agosti, M. and Ferro, N. (2009). Towards an Evaluation Infrastructure for DL Performance Evaluation. In Tsakonas, G. and Papatheodorou, C., editors, Evaluation of Digital Libraries: An Insight to Useful Applications and Methods. Chandos Publishing, Oxford, UK (in print).

    • International Conferences

    2008

    1. Dussin, M. and Ferro, N. (2008). DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns. In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 424. ACM Press, New York, USA.
    2. Dussin, M. and Ferro, N. (2008). The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large-Scale Evaluation Campaigns. In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 450. ACM Press, New York, USA.
    3. Dussin, M. and Ferro, N. (2008). Design of a Digital Library System for Large-Scale Evaluation Campaigns. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 400-401. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
    4. Ferro, N. and Peters, C. (2008). From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum. In Kando, N. and Sugimoto, M., editors, Proc. 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 577-593. National Institute of Informatics, Tokyo, Japan.

    2007

    1. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them? In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 11-20. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.
    2. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). The Importance of Scientific Data Curation for Evaluation Campaigns. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 157-166. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
    3. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). A Proposal to Extend and Enrich the Scientific Data Curation of Evaluation Campaigns. In Sakay, T. and Sanderson, M., and Evans, D. K., editors, Proc. 1st International Workshop on Evaluating Information Access (EVIA 2007), pages 62-73. National Institute of Informatics, Tokyo, Japan.
    4. Agosti, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2007). CLEF: Ongoing Activities and Plans for the Future. In Kando, N. and Evans, D. K., editors, Proc. 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 493-504. National Institute of Informatics, Tokyo, Japan. Invited talk.

    2006

    1. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2006). A Data Curation Approach to Support In-depth Evaluation Studies. In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 65-68. http://ucdata.berkeley.edu/sigir2006-mlia.htm [last visited 2007, August 23].
    2. Di Nunzio, G. M. and Ferro, N. (2006). Scientific Evaluation of a DLMS: a service for evaluating information access components. In Gonzalo, J., Thanos, C., Verdejo, M. F., and Carrasco, R. C., editors, Proc. 10th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2006), pages 536-539. Lecture Notes in Computer Science (LNCS) 4172, Springer, Heidelberg, Germany.

    2005

    1. Di Nunzio, G. M. and Ferro, N. (2005). DIRECT: a Distributed Tool for Information Retrieval Evaluation Campaigns. In Ioannidis, Y., Schek, H.-J., and Weikum, G., editors, Proc. 8th DELOS Thematic Workshop on Future Digital Library Management Systems: System Architecture and Information Access, pages 58-63. http://dbis.cs.unibas.ch/delos_website/delos-dagstuhl-handout-all.pdf [last visited 2007, August 23].
    2. Di Nunzio, G. M., Ferro, N., and Orio, N. (2005). Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources. In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 60-72. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany.

    National Conferences

    2008

    1. Dussin, M. and Ferro, N. (2008). The Design of the User Interface of a Scientific DLS in the context of the Data, Information, Knowledge and Wisdom Hierarchy. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 105-113. ISTI-CNR at Gruppo ALI, Pisa, Italy.
    2. Ferro, N. and Harman, D. (2008). Dealing with MultiLingual Information Access: Grid Experiments at TrebleCLEF. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 29-32. ISTI-CNR at Gruppo ALI, Pisa, Italy.

    2007

    1. Dussin, M. and Ferro, N. (2007). An Effective User Interface for a Scientific DLS to Support Information Retrieval Evaluation. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 18-21. ISTI-CNR at Gruppo ALI, Pisa, Italy.

    2006

    1. Di Nunzio, G. M. and Ferro, N. (2006). Uniform Methodology for Evaluating Information Access Components of Digital Libraries. In Agosti, M. and Thanos, C., editors, Proc. 2nd Italian Research Conference on Digital Library Management Systems (IRCDL 2006), pages 25-28. ISTI-CNR at Gruppo ALI, Pisa, Italy.

    International Working Notes

    2007

    1. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). The Importance of Scientific Data Curation for Evaluation Campaigns. In Thanos, C. and Borri, F., editors, DELOS Conference 2007 Working Notes, pages 185-193. ISTI-CNR, Gruppo ALI, Pisa, Italy.
    2. Dussin, M. and Ferro, N. (2007). Design of the User Interface of a Scientific Digital Library System for Large-Scale Evaluation Campaigns. In Thanos, C. and Borri, F., editors, Second DELOS Conference on Digital Libraries Working Notes. ISTI-CNR, Gruppo ALI, Pisa, Italy.

    2006

    1. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2006). Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them? In Nardi, A., Peters, C., and Vicedo, J. L., editors, Working Notes for the CLEF 2006 Workshop. http://www.clef-campaign.org/2006/working_notes/workingnotes2006/agostiCLEF2006.pdf [last visited 2007, August 23].