Search

Your search keyword '"Mandl, Thomas"' showing total 22 results
Start Over Author "Mandl, Thomas" Topic evaluation

Refine your results

more »

more »

more »
22 results on '"Mandl, Thomas"'

1. Has Retrieval Technology in Vertical Site Search Systems Improved over the Years? A Holistic Evaluation for Real Web Systems

Author

Mandl, Thomas, Womser-Hacker, Christa, and Gatzke, Natalia

Subjects
Site Search, Information Retrieval, Evaluation, Bibliography. Library science. Information resources
Abstract

Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.

Published
2015
Full Text
View/download PDF

4. Visualising Topics in Document Collections

Author

Christoforidis, Anastasia, Heuwing, Ben, and Mandl, Thomas

Subjects
user study, evaluation, ddc:020, information visualisations, 020 Bibliotheks- und Informationswissenschaft, digital humanities, topic modelling
Abstract

This paper discusses two multivariate visualisations which provide insights into topic model distributions across subcollections of a collection of historical textbooks in the context of a digital humanities project. Results of a qualitative user study with experts in historical research indicate that network graphs are more appropriate for revealing general connections among subcollections, while small-multiples of heatmaps of topic correlations are more suitable for a finer grained analysis of the connections between specific topics. We analyse the user behaviour during analysis to identify general activities of the interpretation of topic models as well as activities of interpreting visual elements that are specific to each visualisation. As a result, we observed usability problems and show potential for improved visualisations in digital humanities applications.

Published
2017

5. CLEF NewsREEL 2017 Overview: Contextual Bandit News Recommendation

Author

Liang, Yu, Loni, B., Larson, M.A., Cappellato, Linda, Ferro, Nicola, Goeuriot, Lorraine, and Mandl, Thomas

Subjects
Contextual Bandit, Recommender System, Context, News, Evaluation
Abstract

In the CLEF NewsREEL 2017 challenge, we build a delegation model based on the contextual bandit algorithm. Our goal is to investigate whether a bandit approach combined with context extracted from the user side, from the item side and from user-item interaction can help choose the appropriate recommender from a recommender algorithm pool for the incoming recommendation requests. We took part in both tasks: NewsREEL Live and NewsREEL Replay. In the experiment, we test several bandit approaches with two types of context features. The result from NewsREEL Replay suggests that delegation model based on the contextual bandit algorithm can improve the click through rate (CTR). In NewsREEL Live, a similar delegation model is implemented. However, the delegation model from NewsREEL Live is trained by the data stream from NewsREEL Replay. This is due to the fact that the low volume of data received from the online scenario is not enough to support the training of the delegation model. For our future work, we will add more recommender algorithms to the recommender algorithm pool and explores other context features.

Published
2017

6. Die Erkennung unangemessener Inhalte im Internet: KI-Verfahren, Evaluierung und Herausforderungen.

Author

Mandl, Thomas

Subjects
*ARTIFICIAL intelligence, *INTERNET
Abstract

In sozialen Medien finden sich sehr oft aggressive und hasserfüllte Posts. Deren automatische Erkennung ist wünschenswert und wird derzeit intensiv erforscht. Die Qualität der entsprechenden Algorithmen muss laufend bewertet werden. Der Artikel berichtet von Evaluierungsergebnissen und den Herausforderungen im Rahmen der HASOC Initiative 2019. Davor werden die neuronale Netzwerk-Architekturen wie beispielsweise BERT eingeführt, die derzeit die besten Ergebnisse liefern. In social media, aggressive and hateful posts are rather frequent. It is desirable to identify such content automatically and much research is dedicated to this area. The quality of recognition algorithms needs to be constantly monitored. This article reports evaluation results and the challenges within the HASOC initiative 2019. In the first instance, neural network architectures are introduced, as they currently deliver the best result for hate speech recognition. Within the HASOC dataset, the BERT system classified posts with an accuracy of around 80 per cent. [ABSTRACT FROM AUTHOR]

Published
2020
Full Text
View/download PDF

7. Evaluation of a MOOC to Promote Information Literacy First Evaluation Results.

Author

Dreisiebner, Stefan, Žumer, Maja, Vilar, Polona, and Mandl, Thomas

Subjects
INFORMATION literacy, MASSIVE open online courses, SELF-evaluation, INDUSTRIAL management, QUESTIONNAIRES
Abstract

The aim of this paper is to present the evaluation framework and preliminary results of the evaluation for a Massive Open Online Course (MOOC) on Information Literacy (IL) and its application within a Business Administration course. The aim of the evaluation was to assess user experience and progress of the students' knowledge of IL after completing the MOOC. The evaluation approach consisted of three phases: First, the students were asked to fill out a short self-assessment questionnaire and a shortened adopted version of a standardized IL test. Second, they completed the full version of the IL MOOC. Third, they were asked to fill out the full version of a standardized IL test and a user experience questionnaire. The evaluation results show that the MOOC was able to increase the IL skills of the students and was also perceived well. The evaluation approach worked well and can also serve as model for evaluations of other MOOCs, in particular on IL. [ABSTRACT FROM AUTHOR]

Published
2019
Full Text
View/download PDF

8. Recent Developments in the Evaluation of Information Retrieval Systems: Moving Towards Diversity and Practical Relevance.

Author

Mandl, Thomas

Subjects
INFORMATION storage & retrieval systems, COMPUTER systems, INFORMATION retrieval, INFORMATION processing, ELECTRONIC information resources
Abstract

The evaluation of information retrieval systems has gained considerable momentum in the last few years. Several evaluation initiatives are concerned with diverse retrieval applications, innovative usage scenarios and different aspects of system performance. These evaluation initiatives have led to a considerable increase in system performance. Data for evaluation efforts include multilingual corpora, structured data, scientific documents, Web pages as well as multimedia objects. This paper gives an overview of the current activities of the major evaluation initiatives. Special attention is given to the current tracks and developments within TREC, CLEF and NTCIR. The evaluation tasks and issues, as well as some results, will be presented. [ABSTRACT FROM AUTHOR]

Published
2008

9. CLEF 2017 eHealth Evaluation Lab Overview

Author

Goeuriot, Lorraine, Kelly, Liadh, Suominen, Hanna, Névéol, Aurélie, Robert, Aude, Kanoulas, Evangelos, Spijker, Rene, Palotti, João, Zuccon, Guido, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Jones, Gareth J.F., editor, Lawless, Séamus, editor, Gonzalo, Julio, editor, Kelly, Liadh, editor, Goeuriot, Lorraine, editor, Mandl, Thomas, editor, Cappellato, Linda, editor, and Ferro, Nicola, editor

Published
2017
Full Text
View/download PDF

10. CLEF 2017 NewsREEL Overview: A Stream-Based Recommender Task for Evaluation and Education

Author

Lommatzsch, Andreas, Kille, Benjamin, Hopfgartner, Frank, Larson, Martha, Brodt, Torben, Seiler, Jonas, Özgöbek, Özlem, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Jones, Gareth J.F., editor, Lawless, Séamus, editor, Gonzalo, Julio, editor, Kelly, Liadh, editor, Goeuriot, Lorraine, editor, Mandl, Thomas, editor, Cappellato, Linda, editor, and Ferro, Nicola, editor

Published
2017
Full Text
View/download PDF

11. TimeLine Illustration Based on Microblogs: When Diversification Meets Metadata Re-ranking

Author

Mulhem, Philippe, Goeuriot, Lorraine, Dogra, Nayanika, Ould Amer, Nawal, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Jones, Gareth J.F., editor, Lawless, Séamus, editor, Gonzalo, Julio, editor, Kelly, Liadh, editor, Goeuriot, Lorraine, editor, Mandl, Thomas, editor, Cappellato, Linda, editor, and Ferro, Nicola, editor

Published
2017
Full Text
View/download PDF

12. A Pinch of Humor for Short-Text Conversation: An Information Retrieval Approach

Author

Blinov, Vladislav, Mishchenko, Kirill, Bolotova, Valeria, Braslavski, Pavel, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Jones, Gareth J.F., editor, Lawless, Séamus, editor, Gonzalo, Julio, editor, Kelly, Liadh, editor, Goeuriot, Lorraine, editor, Mandl, Thomas, editor, Cappellato, Linda, editor, and Ferro, Nicola, editor

Published
2017
Full Text
View/download PDF

13. The Xtrieval Framework at CLEF 2008: Domain-Specific Track

Author

Kürsten, Jens, Wilhelm, Thomas, Eibl, Maximilian, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Peters, Carol, editor, Deselaers, Thomas, editor, Ferro, Nicola, editor, Gonzalo, Julio, editor, Jones, Gareth J. F., editor, Kurimo, Mikko, editor, Mandl, Thomas, editor, Peñas, Anselmo, editor, and Petras, Vivien, editor

Published
2009
Full Text
View/download PDF

14. The Domain-Specific Track at CLEF 2008

Author

Petras, Vivien, Baerisch, Stefan, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Peters, Carol, editor, Deselaers, Thomas, editor, Ferro, Nicola, editor, Gonzalo, Julio, editor, Jones, Gareth J. F., editor, Kurimo, Mikko, editor, Mandl, Thomas, editor, Peñas, Anselmo, editor, and Petras, Vivien, editor

Published
2009
Full Text
View/download PDF

15. CLEF 2008 Ad-Hoc Track: Comparing and Combining Different IR Approaches

Author

Kürsten, Jens, Wilhelm, Thomas, Eibl, Maximilian, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Peters, Carol, editor, Deselaers, Thomas, editor, Ferro, Nicola, editor, Gonzalo, Julio, editor, Jones, Gareth J. F., editor, Kurimo, Mikko, editor, Mandl, Thomas, editor, Peñas, Anselmo, editor, and Petras, Vivien, editor

Published
2009
Full Text
View/download PDF

16. VideoCLEF 2008: ASR Classification with Wikipedia Categories

Author

Küsrsten, Jens, Richter, Daniel, Eibl, Maximilian, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Peters, Carol, editor, Deselaers, Thomas, editor, Ferro, Nicola, editor, Gonzalo, Julio, editor, Jones, Gareth J. F., editor, Kurimo, Mikko, editor, Mandl, Thomas, editor, Peñas, Anselmo, editor, and Petras, Vivien, editor

Published
2009
Full Text
View/download PDF

17. Overview of VideoCLEF 2008: Automatic Generation of Topic-Based Feeds for Dual Language Audio-Visual Content

Author

Larson, Martha, Newman, Eamonn, Jones, Gareth J. F., Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Peters, Carol, editor, Deselaers, Thomas, editor, Ferro, Nicola, editor, Gonzalo, Julio, editor, Jones, Gareth J. F., editor, Kurimo, Mikko, editor, Mandl, Thomas, editor, Peñas, Anselmo, editor, and Petras, Vivien, editor

Published
2009
Full Text
View/download PDF

18. Robust Question Answering for Speech Transcripts: UPC Experience in QAst 2008

Author

Comas, Pere R., Turmo, Jordi, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Peters, Carol, editor, Deselaers, Thomas, editor, Ferro, Nicola, editor, Gonzalo, Julio, editor, Jones, Gareth J. F., editor, Kurimo, Mikko, editor, Mandl, Thomas, editor, Peñas, Anselmo, editor, and Petras, Vivien, editor

Published
2009
Full Text
View/download PDF

19. Exploring LDA-Based Document Model for Geographic Information Retrieval

Author

Li, Zhisheng, Wang, Chong, Xie, Xing, Wang, Xufa, Ma, Wei-Ying, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Peters, Carol, editor, Jijkoun, Valentin, editor, Mandl, Thomas, editor, Müller, Henning, editor, Oard, Douglas W., editor, Peñas, Anselmo, editor, Petras, Vivien, editor, and Santos, Diana, editor

Published
2008
Full Text
View/download PDF

20. The Domain-Specific Track at CLEF 2007

Author

Petras, Vivien, Baerisch, Stefan, Stempfhuber, Maximillian, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Peters, Carol, editor, Jijkoun, Valentin, editor, Mandl, Thomas, editor, Müller, Henning, editor, Oard, Douglas W., editor, Peñas, Anselmo, editor, Petras, Vivien, editor, and Santos, Diana, editor

Published
2008
Full Text
View/download PDF

21. The XTRIEVAL Framework at CLEF 2007: Domain-Specific Track

Author

Kürsten, Jens, Wilhelm, Thomas, Eibl, Maximilian, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Peters, Carol, editor, Jijkoun, Valentin, editor, Mandl, Thomas, editor, Müller, Henning, editor, Oard, Douglas W., editor, Peñas, Anselmo, editor, Petras, Vivien, editor, and Santos, Diana, editor

Published
2008
Full Text
View/download PDF

22. Detecting offensive speech in conversational code-mixed dialogue on social media: A contextual dataset and benchmark experiments.

Author

Madhu, Hiren, Satapara, Shrey, Modha, Sandip, Mandl, Thomas, and Majumder, Prasenjit

Subjects
*AUTOMATIC speech recognition, *SPEECH, *SOCIAL media, *TEXT recognition, *HATE speech, *SPEECH perception, *USER-generated content
Abstract

The spread of Hate Speech on online platforms is a severe issue for societies and requires the identification of offensive content by platforms. Research has modeled Hate Speech recognition as a text classification problem that predicts the class of a message based on the text of the message only. However, context plays a huge role in communication. In particular, for short messages, the text of the preceding tweets can completely change the interpretation of a message within a discourse. This work extends previous efforts to classify Hate Speech by considering the current and previous tweets jointly. In particular, we introduce a clearly defined way of extracting context. We present the development of the first dataset for conversational-based Hate Speech classification with an approach for collecting context from long conversations for code-mixed Hindi (ICHCL dataset). Overall, our benchmark experiments show that the inclusion of context can improve classification performance over a baseline. Furthermore, we develop a novel processing pipeline for processing the context. The best-performing pipeline uses a fine-tuned SentBERT paired with an LSTM as a classifier. This pipeline achieves a macro F1 score of 0.892 on the ICHCL test dataset. Another KNN, SentBERT, and ABC weighting-based pipeline yields an F1 Macro of 0.807, which gives the best results among traditional classifiers. So even a KNN model gives better results with an optimized BERT than a vanilla BERT model. • Formulate Hate speech detection problem on social media conversational Dialogue. • Develop a code-mixed English–Hindi dataset with a well-defined context. • Proposes context representation scheme for conversational dialogue. • Benchmarked proposed ICHCL dataset on state-of-art classifiers. [ABSTRACT FROM AUTHOR]

Published
2023
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results