Improving scalability of multi-agent deep reinforcement learning with suboptimal human knowledge.

Guoxin Su https://orcid.org/0000-0002-2087-4894

Dingbang Liu Fenghui Ren Jun Yan 0005 Guoxin Su Wen Gu Shohei Kato Improving scalability of multi-agent deep reinforcement learning with suboptimal human knowledge. 2 2026 June 40 Auton. Agents Multi Agent Syst. 1 https://doi.org/10.1007/s10458-025-09729-1 db/journals/aamas/aamas40.html#LiuRYSGK26 streams/journals/aamas

Li Liu 0001 Xueying Wang Shanshan Huang 0004 Zhengqiao Deng Shu Wang 0005 Guang Wu Donglai Yang Sixi Zha Guoxin Su Qing Tao Identifying non-small cell lung cancer subtypes by a hybrid representative causal network with computed tomography images. 2026 114540 174 Eng. Appl. Artif. Intell. https://doi.org/10.1016/j.engappai.2026.114540 db/journals/eaai/eaai174.html#LiuWHDWWYZST26 streams/journals/eaai

Li Liu 0001 Qiwen Pang Shanshan Huang 0004 Laiming Jiang Shu Wang 0005 Guang Wu Guoxin Su Qing Tao Measuring cognitive load by a score-based causal network model with multichannel physiological signals. 131290 2026 659 Neurocomputing https://doi.org/10.1016/j.neucom.2025.131290 db/journals/ijon/ijon659.html#LiuPHJWWST26 streams/journals/ijon

Dingbang Liu Fenghui Ren Jun Yan 0005 Guoxin Su Shohei Kato Wen Gu Reinforcement Learning with Fuzzy Human Attention-Guided Graph for Heterogeneous Multiagent Systems. 23676-23684 2026 AAAI https://doi.org/10.1609/aaai.v40i28.39541 conf/aaai/2026 db/conf/aaai/aaai2026.html#LiuRYSKG26

Guoxin Su Thomas Robinson Hoa Khanh Dam Li Liu 0001 David S. Rosenblum Fault-Tolerant Design and Multi-Objective Model Checking for Real-Time Deep Reinforcement Learning Systems. 2026 March abs/2603.23113 CoRR https://doi.org/10.48550/arXiv.2603.23113 db/journals/corr/corr2603.html#abs-2603-23113 streams/journals/corr

Hong Quy Nguyen Thong Hoang Hoa Khanh Dam Guoxin Su Zhenchang Xing Qinghua Lu 0001 Jiamou Sun Human-understandable explanation for software vulnerability prediction. 112455 2025 228 J. Syst. Softw. https://doi.org/10.1016/j.jss.2025.112455 db/journals/jss/jss228.html#NguyenHDSXLS25 streams/journals/jss

Dingbang Liu Fenghui Ren Jun Yan 0005 Guoxin Su Shohei Kato Wen Gu Minjie Zhang 0001 Human attention guided multiagent hierarchical reinforcement learning for heterogeneous agents. 113377 2025 316 Knowl. Based Syst. https://doi.org/10.1016/j.knosys.2025.113377 db/journals/kbs/kbs316.html#LiuRYSKGZ25 streams/journals/kbs

Zhili Gong 0001 Chunyuan Zheng 0001 Shanshan Huang 0004 Huayi Yang Guoxin Su Li Liu 0001 CDSF: A curvature-driven semi-supervised framework with dynamic receptive fields for fine-grained vehicle component segmentation. 114211 2025 328 Knowl. Based Syst. https://doi.org/10.1016/j.knosys.2025.114211 db/journals/kbs/kbs328.html#GongZHYSL25 streams/journals/kbs

Xiaoxue Liu Shohei Kato Wen Gu Fenghui Ren Guoxin Su Minjie Zhang 0001 Diffusion of Ordinal Opinions in Social Networks: An Agent-Based Model and Heuristics for Campaigning. 335-347 2025 February 12 IEEE Trans. Comput. Soc. Syst. 1 https://doi.org/10.1109/TCSS.2024.3458950 db/journals/tcss/tcss12.html#LiuKGRSZ25 streams/journals/tcss

Dingbang Liu Fenghui Ren Jun Yan 0005 Guoxin Su Wen Gu Shohei Kato Scaling Up Multi-Agent Reinforcement Learning: An Extensive Survey on Scalability Issues. 94610-94631 2024 12 IEEE Access https://doi.org/10.1109/ACCESS.2024.3410318 db/journals/access/access12.html#LiuRYSGK24 streams/journals/access

Xiaoxue Liu Fenghui Ren Guoxin Su Minjie Zhang 0001 Wen Gu Shohei Kato Predicting Voting Outcomes for Multi-Alternative Elections in Social Networks. 98960-98970 2024 12 IEEE Access https://doi.org/10.1109/ACCESS.2024.3425160 db/journals/access/access12.html#LiuRSZGK24 streams/journals/access

Guoxin Su Li Liu 0001 Workflow Trace Profiling and Execution Time Analysis in Quantitative Verification. 319 2024 September 16 Future Internet 9 https://doi.org/10.3390/fi16090319 db/journals/fi/fi16.html#SuL24a streams/journals/fi

Xiaoxue Liu Shohei Kato Wen Gu Fenghui Ren Guoxin Su Minjie Zhang 0001 A pool-based simulated annealing approach for preference-aware influence maximisation in social networks. 112229 2024 300 Knowl. Based Syst. https://doi.org/10.1016/j.knosys.2024.112229 db/journals/kbs/kbs300.html#LiuKGRSZ24 streams/journals/kbs

Xiaohu Li Jiawei Liu Guorui Liao Mingrui Yin Shu Wang 0005 Guoxin Su Jun Liao 0001 Li Liu 0001 Predicting Fall Events by a Spatio-Temporal Topological Network with Multiple Wearable Sensors. 8551-8555 2024 ICASSP https://doi.org/10.1109/ICASSP48485.2024.10446493 conf/icassp/2024 db/conf/icassp/icassp2024.html#LiLLYWSLL24 Dingbang Liu Shohei Kato Wen Gu Fenghui Ren Jun Yan 0005 Guoxin Su Integrating Suboptimal Human Knowledge with Hierarchical Reinforcement Learning for Large-Scale Multiagent Systems. 2024 NeurIPS http://papers.nips.cc/paper_files/paper/2024/hash/ba29e3f830d039c3f1fa0b4dfcf19c54-Abstract-Conference.html conf/nips/2024 db/conf/nips/neurips2024.html#LiuKGR0S24 Saugata Bose Guoxin Su Anomalous Speech Detection: Unleashing the Adaptive Power of VarietyDetect for Enhanced Short-Text Anomaly Detection through Transfer Learning and Self-Training. 345-349 2024 WI/IAT https://doi.org/10.1109/WI-IAT62293.2024.00054 conf/webi/2024 db/conf/webi/webi2024.html#BoseS24

Fatimah Abdulazim Altuhaifa Khin Than Win Guoxin Su Predicting lung cancer survival based on clinical data using machine learning: A review. 107338 2023 October 165 Comput. Biol. Medicine https://doi.org/10.1016/j.compbiomed.2023.107338 db/journals/cbm/cbm165.html#AltuhaifaWS23

Shu Wang 0005 Hao Luo Shanshan Huang 0004 Qingsong Li Li Liu 0001 Guoxin Su Ming Liu 0007 Counterfactual-based minority oversampling for imbalanced classification. 106024 2023 122 Eng. Appl. Artif. Intell. https://doi.org/10.1016/j.engappai.2023.106024 db/journals/eaai/eaai122.html#WangLHL0S023

Fawad Ali Mangi Guoxin Su Minjie Zhang 0001 Statistical Model Checking in Process Mining: A Comprehensive Approach to Analyse Stochastic Processes. 378 2023 15 Future Internet 12 https://doi.org/10.3390/fi15120378 db/journals/fi/fi15.html#MangiSZ23

Wen Gu Shohei Kato Fenghui Ren Guoxin Su Takayuki Ito 0001 Shinobu Hasegawa Influence Propagation Based Influencer Detection in Online Forum. 433-442 2023 April 106 IEICE Trans. Inf. Syst. 4 https://doi.org/10.1587/transinf.2022iip0010 db/journals/ieicetd/ieicetd106.html#GuKRSIH23

Saugata Bose Guoxin Su Li Liu 0001 Deep One-Class Fine-Tuning for Imbalanced Short Text Classification in Transfer Learning. 339-351 2023 ADMA (1) https://doi.org/10.1007/978-3-031-46661-8_23 conf/adma/2023-1 db/conf/adma/adma2023-1.html#BoseSL23 Saugata Bose Guoxin Su LexiFuse+: A Unified One-Class Solution for Imbalanced Short-Text Classification. 1-2 2023 e-Science https://doi.org/10.1109/e-Science58273.2023.10254896 conf/eScience/2023 db/conf/eScience/eScience2023.html#BoseS23 Qin Liang Wen Gu Shohei Kato Fenghui Ren Guoxin Su Takayuki Ito 0001 Minjie Zhang 0001 Partner Selection Strategy in Open, Dynamic and Sociable Environments. 231-240 2023 ICAART (2) https://doi.org/10.5220/0011690400003393 conf/icaart/2023-2 db/conf/icaart/icaart2023-2.html#LiangGKRS0Z23 Qin Liang Wen Gu Shohei Kato Fenghui Ren Guoxin Su Takayuki Ito 0001 Minjie Zhang 0001 Ranking-Based Partner Selection Strategy in Open, Dynamic and Sociable Environments. 267-285 2023 ICAART (Revised Selected Paper) https://doi.org/10.1007/978-3-031-55326-4_13 conf/icaart/2023s db/conf/icaart/icaart2023s.html#LiangGKRSIZ23 Thomas Robinson Guoxin Su Multi-objective Task Assignment and Multiagent Planning with Hybrid GPU-CPU Acceleration. 260-277 2023 NFM https://doi.org/10.1007/978-3-031-33170-1_16 conf/nfm/2023 db/conf/nfm/nfm2023.html#RobinsonS23 Saugata Bose Guoxin Su LexiFusedNet: A Unified Approach for Imbalanced Short-Text Classification Using Lexicon-Based Feature Extraction, Transfer Learning and One Class Classifiers. 70-82 2023 PKAW https://doi.org/10.1007/978-981-99-7855-7_6 conf/pkaw/2023 db/conf/pkaw/pkaw2023.html#BoseS23 Xiaoxue Liu Shohei Kato Fenghui Ren Guoxin Su Minjie Zhang 0001 Wen Gu Information Gerrymandering in Elections. 83-97 2023 PKAW https://doi.org/10.1007/978-981-99-7855-7_7 conf/pkaw/2023 db/conf/pkaw/pkaw2023.html#LiuKRSZG23

Thomas Robinson Guoxin Su Multi-Objective Task Assignment and Multiagent Planning with Hybrid GPU-CPU Acceleration. 2023 abs/2305.04397 CoRR https://doi.org/10.48550/arXiv.2305.04397 db/journals/corr/corr2305.html#abs-2305-04397

Shu Wang 0005 Aiguo Wang 0002 Mengyuan Ran Li Liu 0001 Yuxin Peng 0002 Ming Liu 0007 Guoxin Su Adi Alhudhaif Fayadh Alenezi Norah Alnaim Hand gesture recognition framework using a lie group based spatio-temporal recurrent network with multiple hand-worn motion sensors. 722-741 2022 606 Inf. Sci. https://doi.org/10.1016/j.ins.2022.05.085 https://www.wikidata.org/entity/Q115351909 db/journals/isci/isci606.html#WangWRLPLSAAA22

Yande Li Lulan Yu Jun Liao 0001 Guoxin Su Ammarah Hashmi Li Liu 0001 Shu Wang 0005 A single smartwatch-based segmentation approach in human activity recognition. 101600 2022 83 Pervasive Mob. Comput. https://doi.org/10.1016/j.pmcj.2022.101600 db/journals/percom/percom83.html#LiYLSHLW22

Guoxin Su Li Liu 0001 Minjie Zhang 0001 David S. Rosenblum Quantitative Verification for Monitoring Event-Streaming Systems. 538-550 2022 48 IEEE Trans. Software Eng. 2 https://doi.org/10.1109/TSE.2020.2996033 db/journals/tse/tse48.html#SuLZR22

Xiaoxue Liu Fenghui Ren Guoxin Su Minjie Zhang 0001 Strategies Improve Social Welfare: An Empirical Study of Strategic Voting in Social Networks. 203-215 2022 AI https://doi.org/10.1007/978-3-030-97546-3_17 conf/ausai/2022 db/conf/ausai/ausai2022.html#LiuRSZ22 Saugata Bose Guoxin Su Deep One-Class Hate Speech Detection Model. 7040-7048 2022 LREC https://aclanthology.org/2022.lrec-1.761 conf/lrec/2022 db/conf/lrec/lrec2022.html#BoseS22 Zirui Yong Guoxin Su Xiaohu Li Lingyun Sun Zejian Li Li Liu 0001 Recognizing Cognitive Load by a Hybrid Spatio-Temporal Causal Model from Multivariate Physiological Data. 318-334 2022 ECML/PKDD (6) https://doi.org/10.1007/978-3-031-26422-1_20 conf/pkdd/2022-6 db/conf/pkdd/pkdd2022-6.html#YongSLSLL22

Jun Liao 0001 Dandan Liu Guoxin Su Li Liu 0001 Recognizing diseases with multivariate physiological signals by a DeepCNN-LSTM network. 7933-7945 2021 51 Appl. Intell. 11 https://doi.org/10.1007/s10489-021-02309-2 db/journals/apin/apin51.html#LiaoLSL21

Thomas Robinson Guoxin Su Minjie Zhang 0001 Multiagent Task Allocation and Planning with Multi-Objective Requirements. 1628-1630 2021 AAMAS https://www.ifaamas.org/Proceedings/aamas2021/pdfs/p1628.pdf https://dl.acm.org/doi/10.5555/3463952.3464182 conf/atal/2021 db/conf/atal/aamas2021.html#RobinsonSZ21 Wen Gu Shohei Kato Fenghui Ren Guoxin Su Takayuki Ito 0001 Influential Online Forum User Detection Based on User Contribution and Relevance. 13-18 2021 ICA https://doi.org/10.1109/ICA54137.2021.00009 conf/ica2/2021 db/conf/ica2/ica2021.html#GuKRS021 Jingxiang Zhang Siyu Qian Guoxin Su Chao Deng 0009 Ping Yu 0004 Predicting Readmission Following Hospital Treatment for Patients with Alcohol Related Diagnoses in an Australian Regional Health District. 1072-1073 2021 MedInfo https://doi.org/10.3233/SHTI220273 conf/medinfo/2021 db/conf/medinfo/medinfo2021.html#ZhangQSDY21 Yidi Zhang Mengyuan Ran Jun Liao 0001 Guoxin Su Ming Liu 0007 Li Liu 0001 Stacked LSTM-Based Dynamic Hand Gesture Recognition with Six-Axis Motion Sensors. 2568-2575 2021 SMC https://doi.org/10.1109/SMC52423.2021.9658659 conf/smc/2021 db/conf/smc/smc2021.html#ZhangRLSL021

Kunxia Wang Guoxin Su Li Liu 0001 Shu Wang 0005 Wavelet packet analysis for speaker-independent emotion recognition. 257-264 2020 398 Neurocomputing https://doi.org/10.1016/j.neucom.2020.02.085 db/journals/ijon/ijon398.html#WangSLW20

Danni Wang Li Liu 0001 Guoxin Su Yande Li Aamir Khan Recognizing Diseases from Physiological Time Series Data Using Probabilistic Model. 388-399 2018 KSEM (1) https://doi.org/10.1007/978-3-319-99365-2_34 conf/ksem/2018-1 db/conf/ksem/ksem2018-1.html#WangLSLK18 Yamilet R. Serrano Llerena Marcel Böhme Marc Brünink Guoxin Su David S. Rosenblum Verifying the long-run behavior of probabilistic system models in the presence of uncertainty. 587-597 2018 ESEC/SIGSOFT FSE https://doi.org/10.1145/3236024.3236078 conf/sigsoft/2018 db/conf/sigsoft/fse2018.html#LlerenaBBSR18

Li Liu 0001 Shu Wang 0005 Guoxin Su Bin Hu 0001 Yuxin Peng 0002 Qingyu Xiong Junhao Wen 0001 A framework of mining semantic-based probabilistic event relations for complex activity recognition. 13-33 2017 418 Inf. Sci. https://doi.org/10.1016/j.ins.2017.07.022 db/journals/isci/isci418.html#LiuWSHPXW17

Li Liu 0001 Shu Wang 0005 Guoxin Su Zi-Gang Huang Ming Liu 0007 Towards complex activity recognition using a Bayesian network-based probabilistic generative framework. 295-309 2017 68 Pattern Recognit. https://doi.org/10.1016/j.patcog.2017.02.028 db/journals/pr/pr68.html#LiuWSHL17

Lei Liu Guoxin Su Jing Xu 0008 Biao Zhang Jiehui Kang Sihan Xu Peng Li Guannan Si An Inferential Metamorphic Testing Approach to Reduce False Positives in SQLIV Penetration Test. 675-680 2017 COMPSAC (1) https://doi.org/10.1109/COMPSAC.2017.276 https://doi.ieeecomputersociety.org/10.1109/COMPSAC.2017.276 conf/compsac/2017-1 db/conf/compsac/compsac2017-1.html#LiuSXZKXLS17 Guoxin Su Taolue Chen 0001 Yuan Feng 0001 David S. Rosenblum ProEva: runtime proactive performance evaluation based on continuous-time markov chains. 484-495 2017 ICSE https://doi.org/10.1109/ICSE.2017.51 https://doi.ieeecomputersociety.org/10.1109/ICSE.2017.51 http://dl.acm.org/citation.cfm?id=3097426 conf/icse/2017 db/conf/icse/icse2017.html#SuCFR17 Yamilet R. Serrano Llerena Guoxin Su David S. Rosenblum Probabilistic model checking of perturbed MDPs with applications to cloud computing. 454-464 2017 ESEC/SIGSOFT FSE https://doi.org/10.1145/3106237.3106301 conf/sigsoft/2017 db/conf/sigsoft/fse2017.html#LlerenaSR17

Guoxin Su Yuan Feng 0001 Taolue Chen 0001 David S. Rosenblum Asymptotic Perturbation Bounds for Probabilistic Model Checking with Empirically Determined Probability Parameters. 623-639 2016 42 IEEE Trans. Software Eng. 7 https://doi.org/10.1109/TSE.2015.2508444 http://doi.ieeecomputersociety.org/10.1109/TSE.2015.2508444 db/journals/tse/tse42.html#SuFCR16

Guoxin Su Taolue Chen 0001 Yuan Feng 0001 David S. Rosenblum P. S. Thiagarajan An Iterative Decision-Making Scheme for Markov Decision Processes and Its Application to Self-adaptive Systems. 269-286 2016 FASE https://doi.org/10.1007/978-3-662-49665-7_16 conf/fase/2016 db/conf/fase/fase2016.html#SuCFRT16 Guoxin Su David S. Rosenblum Giordano Tamburrelli Reliability of Run-Time Quality-of-Service evaluation using parametric model checking. 73-84 2016 ICSE https://doi.org/10.1145/2884781.2884814 https://ieeexplore.ieee.org/document/7886893/ conf/icse/2016 db/conf/icse/icse2016.html#SuRT16 Guoxin Su David S. Rosenblum Nested Reachability Approximation for Discrete-Time Markov Chains with Univariate Parameters. 364-379 2014 ATVA https://doi.org/10.1007/978-3-319-11936-6_26 conf/atva/2014 db/conf/atva/atva2014.html#SuR14 Taolue Chen 0001 Yuan Feng 0001 David S. Rosenblum Guoxin Su Perturbation Analysis in Verification of Discrete-Time Markov Chains. 218-233 2014 CONCUR https://doi.org/10.1007/978-3-662-44584-6_16 conf/concur/2014 db/conf/concur/concur2014.html#ChenFRS14 Guoxin Su David S. Rosenblum Perturbation analysis of stochastic systems with empirical distribution parameters. 311-321 2014 ICSE https://doi.org/10.1145/2568225.2568256 conf/icse/2014 db/conf/icse/icse2014.html#SuR14 Guoxin Su Software architecture modelling and analysis in process algebra University of Technology Sydney, Australia 2013 https://hdl.handle.net/10453/23394 Guoxin Su David S. Rosenblum Asymptotic Bounds for Quantitative Verification of Perturbed Probabilistic Systems. 297-312 2013 ICFEM https://doi.org/10.1007/978-3-642-41202-8_20 conf/icfem/2013 db/conf/icfem/icfem2013.html#SuR13

Guoxin Su David S. Rosenblum Asymptotic Bounds for Quantitative Verification of Perturbed Probabilistic Systems http://arxiv.org/abs/1304.7614 2013 CoRR abs/1304.7614 db/journals/corr/corr1304.html#abs-1304-7614

Guoxin Su Mingsheng Ying Chengqi Zhang Semantic Analysis of Component-aspect Dynamism for Connector-based Architecture Styles. 151-160 2012 WICSA/ECSA https://doi.org/10.1109/WICSA-ECSA.212.23 conf/wicsa/2012 db/conf/wicsa/wicsa2012.html#SuYZ12

Guoxin Su Mingsheng Ying Chengqi Zhang Session Communication and Integration http://arxiv.org/abs/1210.2125 2012 CoRR abs/1210.2125 db/journals/corr/corr1210.html#abs-1210-2125

Guoxin Su Mingsheng Ying Chengqi Zhang An ADL-Approach to Specifying and Analyzing Centralized-Mode Architectural Connection. 8-23 2010 ECSA https://doi.org/10.1007/978-3-642-15114-9_4 conf/ecsa/2010 db/conf/ecsa/ecsa2010.html#SuYZ10 Fayadh Alenezi Adi Alhudhaif Norah Alnaim Fatimah Abdulazim Altuhaifa Marcel Böhme Saugata Bose Marc Brünink Taolue Chen 0001 Khanh Hoa DamHoa Khanh Dam Chao Deng 0009 Zhengqiao Deng Yuan Feng 0001 Zhili Gong 0001 Wen Gu Shinobu Hasegawa Ammarah Hashmi Thong Hoang Bin Hu 0001 Shanshan Huang 0004 Zi-Gang Huang Takayuki Ito 0001 Laiming Jiang Jiehui Kang Shohei Kato Aamir Khan Peng Li Qingsong Li Xiaohu Li Yande Li Zejian Li Qin Liang Guorui Liao Jun Liao 0001 Dandan Liu Dingbang Liu Jiawei Liu Lei Liu Li Liu 0001 Ming Liu 0007 Xiaoxue Liu Yamilet R. Serrano Llerena Qinghua Lu 0001 Hao Luo Fawad Ali Mangi Hong Quy Nguyen Qiwen Pang Yuxin Peng 0002 Siyu Qian Mengyuan Ran Fenghui Ren Thomas Robinson David S. Rosenblum Guannan Si Jiamou Sun Lingyun Sun Giordano Tamburrelli Qing Tao P. S. Thiagarajan Aiguo Wang 0002 Danni Wang Kunxia Wang Shu Wang 0005 Xueying Wang Junhao Wen 0001 Khin Than Win Guang Wu Zhenchang Xing Qingyu Xiong Jing Xu 0008 Sihan Xu Jun Yan 0005 Donglai Yang Huayi Yang Mingrui Yin Mingsheng Ying Zirui Yong Lulan Yu Ping Yu 0004 Sixi Zha Biao Zhang Chengqi Zhang Jingxiang Zhang Minjie Zhang 0001 Yidi Zhang Chunyuan Zheng 0001