{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T01:11:13Z","timestamp":1759972273939,"version":"build-2065373602"},"reference-count":59,"publisher":"Wiley","issue":"12","license":[{"start":{"date-parts":[[2021,5,26]],"date-time":"2021-05-26T00:00:00Z","timestamp":1621987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/http\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["asistdl.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Asso for Info Science &amp;amp; Tech"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Conversational interfaces are increasingly popular as a way of connecting people to information. With the increased generative capacity of corpus\u2010based conversational agents comes the need to classify and filter out malevolent responses that are inappropriate in terms of content and dialogue acts. Previous studies on the topic of detecting and classifying inappropriate content are mostly focused on a specific category of malevolence or on single sentences instead of an entire dialogue. We make three contributions to advance research on the malevolent dialogue response detection and classification (MDRDC) task. First, we define the task and present a hierarchical malevolent dialogue taxonomy. Second, we create a labeled multiturn dialogue data set and formulate the MDRDC task as a hierarchical classification task. Last, we apply state\u2010of\u2010the\u2010art text classification methods to the MDRDC task, and report on experiments aimed at assessing the performance of these approaches.<\/jats:p>","DOI":"10.1002\/asi.24496","type":"journal-article","created":{"date-parts":[[2021,5,26]],"date-time":"2021-05-26T05:52:01Z","timestamp":1622008321000},"page":"1477-1497","update-policy":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A taxonomy, data set, and benchmark for detecting and classifying malevolent dialogue responses"],"prefix":"10.1002","volume":"72","author":[{"given":"Yangjun","family":"Zhang","sequence":"first","affiliation":[{"name":"University of Amsterdam  Amsterdam The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pengjie","family":"Ren","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Shandong University  Qingdao China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maarten","family":"de Rijke","sequence":"additional","affiliation":[{"name":"University of Amsterdam  Amsterdam The Netherlands"},{"name":"Ahold Delhaize Research  Zaandam The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2021,5,26]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"crossref","unstructured":"Abbet C. M'hamdi M. Giannakopoulos A. West R. Hossmann A. Baeriswyl M. &Musat C.(2018).Churn intent detection in multilingual chatbot conversations and social media.arXiv PreprintarXiv:1808.08432.","DOI":"10.18653\/v1\/K18-1016"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331262"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300484"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S19-2007"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.485"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.154"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/355112.355123"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcss.2013.03.007"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359249"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287587"},{"key":"e_1_2_12_12_1","first-page":"2902","volume-title":"Advances in Neural Information Processing Systems","author":"Corbi\u00e8re C.","year":"2019"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.130"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v11i1.14955"},{"key":"e_1_2_12_15_1","doi-asserted-by":"publisher","DOI":"10.1162\/0891201053630291"},{"key":"e_1_2_12_16_1","first-page":"4171","volume-title":"Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics","author":"Devlin J.","year":"2019"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.99.3.550"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343413.3377981"},{"volume-title":"Diagnostic and statistical manual of mental disorders: Dsm\u2010v","year":"2013","author":"Francesmonneris A.","key":"e_1_2_12_19_1"},{"key":"e_1_2_12_20_1","first-page":"1371","volume-title":"Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval","author":"Gao J.","year":"2018"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1091"},{"key":"e_1_2_12_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24143"},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278777"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1268"},{"key":"e_1_2_12_25_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324900002497"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.5121\/ijdkp.2015.5201"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313415"},{"key":"e_1_2_12_28_1","unstructured":"Jiang S. Wolf T. Monz C. &deRijke M.(2020).TLDR: Token loss dynamic reweighting for reducing repetitive utterance generation.arXiv PreprintarXiv:2003.11963."},{"key":"e_1_2_12_29_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1181"},{"key":"e_1_2_12_30_1","first-page":"1","volume-title":"Proceedings of the First Workshop on Trolling, Aggression and Cyberbullying","author":"Kumar R.","year":"2018"},{"key":"e_1_2_12_31_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v29i1.9513"},{"key":"e_1_2_12_32_1","first-page":"2177","volume-title":"Advances in Neural Information Processing Systems","author":"Levy O.","year":"2014"},{"key":"e_1_2_12_33_1","first-page":"986","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Li Y.","year":"2017"},{"key":"e_1_2_12_34_1","first-page":"2873","volume-title":"Proceedings of the 25th International Joint Conferences on Artificial Intelligence","author":"Liu P.","year":"2016"},{"key":"e_1_2_12_35_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4640"},{"key":"e_1_2_12_36_1","doi-asserted-by":"publisher","DOI":"10.2307\/248873"},{"key":"e_1_2_12_37_1","doi-asserted-by":"publisher","DOI":"10.11613\/BM.2012.031"},{"key":"e_1_2_12_38_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20916"},{"key":"e_1_2_12_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20926"},{"key":"e_1_2_12_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186005"},{"key":"e_1_2_12_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bushor.2019.08.005"},{"key":"e_1_2_12_42_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6395"},{"key":"e_1_2_12_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609595"},{"key":"e_1_2_12_44_1","first-page":"172","volume-title":"Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics","author":"Ritter A.","year":"2010"},{"key":"e_1_2_12_45_1","first-page":"583","volume-title":"Proceedings of the Empirical Methods in Natural Language Processing","author":"Ritter A.","year":"2011"},{"key":"e_1_2_12_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/jnp.12155"},{"key":"e_1_2_12_47_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699930441000481"},{"key":"e_1_2_12_48_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203843130"},{"key":"e_1_2_12_49_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5105"},{"key":"e_1_2_12_50_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1006610329284"},{"key":"e_1_2_12_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331223"},{"key":"e_1_2_12_52_1","unstructured":"Wang R. Su H. Wang C. Ji K. &Ding J.(2019).To tune or not to tune? How about the best of both worlds?arXiv PreprintarXiv:1907.05338."},{"key":"e_1_2_12_53_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-2013"},{"key":"e_1_2_12_54_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1046"},{"key":"e_1_2_12_55_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33017370"},{"key":"e_1_2_12_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380126"},{"key":"e_1_2_12_57_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1144"},{"key":"e_1_2_12_58_1","doi-asserted-by":"publisher","DOI":"10.1089\/cyber.2017.0518"},{"key":"e_1_2_12_59_1","first-page":"649","volume-title":"Advances in Neural Information Processing Systems","author":"Zhang X.","year":"2015"},{"key":"e_1_2_12_60_1","first-page":"3740","volume-title":"Proceedings of the 27th International Conference on Computational Linguistics","author":"Zhang Z.","year":"2018"}],"container-title":["Journal of the Association for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.24496","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/asi.24496","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.24496","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T20:20:39Z","timestamp":1759954839000},"score":1,"resource":{"primary":{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/asi.24496"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,26]]},"references-count":59,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1002\/asi.24496"],"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.1002\/asi.24496","archive":["Portico"],"relation":{},"ISSN":["2330-1635","2330-1643"],"issn-type":[{"type":"print","value":"2330-1635"},{"type":"electronic","value":"2330-1643"}],"subject":[],"published":{"date-parts":[[2021,5,26]]},"assertion":[{"value":"2020-08-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-05","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}