SYNCode: Synergistic Human-LLM Collaboration for Enhanced Data Annotation in Stack Overflow.

Myoungkyu Song University of Nebraska at Omaha, Department of Computer Science, NE, USA University of Texas at Austin, ARiSE, TX, USA Virginia Tech, Blacksburg, VA, USA https://sites.google.com/site/mksongprofile https://www.unomaha.edu/college-of-information-science-and-technology/about/faculty-staff/myoungkyu-song.php https://dl.acm.org/profile/81436594687 https://orcid.org/0000-0003-4477-8933 https://ieeexplore.ieee.org/author/37086056020

Meng Xia Shradha Maharjan Tammy Le Will Taylor Myoungkyu Song SYNCode: Synergistic Human-LLM Collaboration for Enhanced Data Annotation in Stack Overflow. 392 2025 16 Inf. 5 https://doi.org/10.3390/info16050392 db/journals/information/information16.html#XiaMLTS25 streams/journals/information

Meng Xia Shradha Maharjan Myoungkyu Song Automated Code Summarization by Training Large Language Models with Crowdsourced Knowledge. 126-133 2025 SERA https://doi.org/10.1109/SERA65747.2025.11154515 conf/sera/2025 db/conf/sera/sera2025.html#XiaMS25 Shradha Maharjan Meng Xia Tae-Hyuk Ahn Myoungkyu Song Intelligent Code Completion by a Unified Multi-task Learning with a Large Language Model. 134-142 2025 SERA https://doi.org/10.1109/SERA65747.2025.11154531 conf/sera/2025 db/conf/sera/sera2025.html#MaharjanXAS25 Tammy Le Will Taylor Shradha Maharjan Meng Xia Myoungkyu Song SYNC: SYnergistic aNnotation Collaboration between Humans and LLMs for Enhanced Model Training. 158-162 2025 SERA https://doi.org/10.1109/SERA65747.2025.11154541 conf/sera/2025 db/conf/sera/sera2025.html#LeTMXS25

Kwok Sun Cheng Pei-Chi Huang Tae-Hyuk Ahn Myoungkyu Song Tool Support for Improving Software Quality in Machine Learning Programs. 53 2023 January 14 Inf. 1 https://doi.org/10.3390/info14010053 https://www.wikidata.org/entity/Q120835937 db/journals/information/information14.html#ChengHAS23

Dip Kiran Pradhan Newar Rui Zhao 0005 Harvey P. Siy Leen-Kiat Soh Myoungkyu Song SSDTutor: A feedback-driven intelligent tutoring system for secure software development. 102933 2023 April 227 Sci. Comput. Program. https://doi.org/10.1016/j.scico.2023.102933 https://www.wikidata.org/entity/Q121356549 db/journals/scp/scp227.html#NewarZSSS23

Samuel Sungmin Cho Myoungkyu Song Programming Model for Information Sharing among IoT Devices: Software Engineering Perspective. 116-121 2023 SERA https://doi.org/10.1109/SERA57763.2023.10197720 conf/sera/2023 db/conf/sera/sera2023.html#ChoS23 Deepak Panda Piyush Basia Kushal Nallavolu Xin Zhong Harvey P. Siy Myoungkyu Song A Statistical Method for API Usage Learning and API Misuse Violation Finding. 358-365 2023 SERA https://doi.org/10.1109/SERA57763.2023.10197708 conf/sera/2023 db/conf/sera/sera2023.html#PandaBNZSS23 Piyush Basia Tae-Hyuk Ahn Myoungkyu Song An IDE Support for Validating Machine Learning Applications in Bioengineering Text Corpora. 3594-3595 2022 BIBM https://doi.org/10.1109/BIBM55620.2022.9995298 conf/bibm/2022 db/conf/bibm/bibm2022.html#BasiaAS22 Pei-Chi Huang Ejan Shakya Myoungkyu Song Mahadevan Subramaniam BioMDSE: A Multimodal Deep Learning-Based Search Engine Framework for Biofilm Documents Classifications. 3608-3612 2022 BIBM https://doi.org/10.1109/BIBM55620.2022.9994867 conf/bibm/2022 db/conf/bibm/bibm2022.html#HuangSSS22 Rui Zhao 0005 Harvey P. Siy Chulwoo Pack Leen-Kiat Soh Myoungkyu Song An Intelligent Tutoring System for API Misuse Correction by Instant Quality Feedback. 123-128 2022 COMPSAC https://doi.org/10.1109/COMPSAC54236.2022.00026 conf/compsac/2022 db/conf/compsac/compsac2022.html#ZhaoSPSS22 Kwok Sun Cheng Tae-Hyuk Ahn Myoungkyu Song Debugging Support for Machine Learning Applications in Bioengineering Text Corpora. 1062-1069 2022 COMPSAC https://doi.org/10.1109/COMPSAC54236.2022.00166 conf/compsac/2022 db/conf/compsac/compsac2022.html#ChengAS22 Michael Menard Tommy Nelson Milan Shahi Hugh Morton Adam DeTavernier Harvey P. Siy Rui Zhao 0005 Myoungkyu Song A Feasibility Study of Using Code Clone Detection for Secure Programming Education. 1502-1507 2022 COMPSAC https://doi.org/10.1109/COMPSAC54236.2022.00238 conf/compsac/2022 db/conf/compsac/compsac2022.html#MenardNSMDSZS22 Jun Wang Samuel Sungmin Cho Myoungkyu Song RepChaBug: Automatically Repairing Incorrect Change Bugs in Software Evolution. 1525-1530 2022 COMPSAC https://doi.org/10.1109/COMPSAC54236.2022.00242 conf/compsac/2022 db/conf/compsac/compsac2022.html#WangCS22 Larry Singleton Rui Zhao 0005 Harvey P. Siy Myoungkyu Song FireBugs: Finding and Repairing Cryptography API Misuses in Mobile Applications. 1194-1201 2021 COMPSAC https://doi.org/10.1109/COMPSAC51774.2021.00165 conf/compsac/2021 db/conf/compsac/compsac2021.html#SingletonZSS21 Kwok Sun Cheng Myoungkyu Song Learning To Rank Relevant Documents for Information Retrieval in Bioengineering Text Corpora. 1565-1572 2021 COMPSAC https://doi.org/10.1109/COMPSAC51774.2021.00233 conf/compsac/2021 db/conf/compsac/compsac2021.html#ChengS21 Uy Nguyen Kwok Sun Cheng Samuel Sungmin Cho Myoungkyu Song Analyzing Bug Reports by Topic Mining in Software Evolution. 1645-1652 2021 COMPSAC https://doi.org/10.1109/COMPSAC51774.2021.00246 conf/compsac/2021 db/conf/compsac/compsac2021.html#NguyenCCS21 Samuel Sungmin Cho Myoungkyu Song Size Efficient Key-Value Type Context Sharing in Mobile Edge Computing. 77-82 2021 EIT https://doi.org/10.1109/EIT51626.2021.9491881 conf/eit/2021 db/conf/eit/eit2021.html#ChoS21 Kwangsung Oh Myoungkyu Song Cocoa: Towards a Scalable Compute Cost-aware Data Analytics System. 110-117 2021 IC2E https://doi.org/10.1109/IC2E52221.2021.00025 conf/ic2e/2021 db/conf/ic2e/ic2e2021.html#OhS21 Krishna Teja Ayinala Kwok Sun Cheng Kwangsung Oh Teukseob Song Myoungkyu Song Code Inspection Support for Recurring Changes with Deep Learning in Evolving Software. 931-942 2020 COMPSAC https://doi.org/10.1109/COMPSAC48688.2020.0-149 conf/compsac/2020 db/conf/compsac/compsac2020.html#AyinalaCOSS20 Uy Nguyen Xinyu Zeng Samuel Sungmin Cho Myoungkyu Song Tool Support for Finding Anomalies in Refactoring Edits for Improving Software Evolution. 1-7 2020 EIT https://doi.org/10.1109/EIT48999.2020.9248703 conf/eit/2020 db/conf/eit/eit2020.html#NguyenZCS20 Krishna Teja Ayinala Kwok Sun Cheng Kwangsung Oh Myoungkyu Song Tool Support for Code Change Inspection with Deep Learning in Evolving Software. 13-17 2020 EIT https://doi.org/10.1109/EIT48999.2020.9208280 conf/eit/2020 db/conf/eit/eit2020.html#AyinalaCOS20 Samuel Sungmin Cho Tami Farber Clinton Schultz Nicholas Caporusso Myoungkyu Song SMIILE: Smart Module Integration for IoT Programming Logic and Environment. 121-126 2020 EIT https://doi.org/10.1109/EIT48999.2020.9208234 conf/eit/2020 db/conf/eit/eit2020.html#ChoFSCS20 Kwok Sun Cheng Zhipeng Wang Pei-Chi Huang Parvathi Chundi Myoungkyu Song TopExplorer: Tool Support for Extracting and Visualizing Topic Models in Bioengineering Text Corpora. 334-343 2020 EIT https://doi.org/10.1109/EIT48999.2020.9208294 conf/eit/2020 db/conf/eit/eit2020.html#ChengWHCS20 Larry Singleton Rui Zhao 0005 Myoungkyu Song Harvey P. Siy CryptoTutor: Teaching Secure Coding Practices through Misuse Pattern Detection. 403-408 2020 SIGITE https://doi.org/10.1145/3368308.3415419 conf/sigite/2020 db/conf/sigite/sigite2020.html#SingletonZSS20

Vamshi Krishna Epuri Sushma Sakala Tae-Hyuk Ahn Myoungkyu Song Tool support for managing repetitive program changes in evolving software. 447-455 2019 13 IET Softw. 5 https://doi.org/10.1049/iet-sen.2018.5356 db/journals/iet-sen/iet-sen13.html#EpuriSAS19

Bo Guo 0004 Young-Woo Kwon 0001 Myoungkyu Song Decomposing Composite Changes for Code Review and Regression Test Selection in Evolving Software. 416-436 2019 34 J. Comput. Sci. Technol. 2 https://doi.org/10.1007/s11390-019-1917-9 https://www.wikidata.org/entity/Q128133735 db/journals/jcst/jcst34.html#GuoKS19

Yuchen Wang Kwok Sun Cheng Myoungkyu Song Eli Tilevich A declarative enhancement of JavaScript programs by leveraging the Java metadata infrastructure. 27-46 2019 181 Sci. Comput. Program. https://doi.org/10.1016/j.scico.2019.05.005 https://www.wikidata.org/entity/Q123024865 db/journals/scp/scp181.html#WangCST19

Sushma Sakala Vamshi Krishna Epuri Samuel Sungmin Cho Myoungkyu Song LAC: Locating and Applying Consistent and Repetitive Changes. 179-184 2019 COMPSAC (1) https://doi.org/10.1109/COMPSAC.2019.00032 conf/compsac/2019-1 db/conf/compsac/compsac2019-1.html#SakalaECS19 Samuel Sungmin Cho Benjamin Gooder Myoungkyu Song Size Efficient Messaging System (SEMS) Using Probabilistic Data Structures. 225-229 2019 EIT https://doi.org/10.1109/EIT.2019.8834272 conf/eit/2019 db/conf/eit/eit2019.html#ChoGS19 Larry Singleton Rui Zhao 0005 Myoungkyu Song Harvey P. Siy FireBugs: finding and repairing bugs with security patterns. 30-34 2019 MOBILESoft@ICSE https://doi.org/10.1109/MOBILESoft.2019.00014 https://dl.acm.org/citation.cfm?id=3340738 conf/icse/2019mobilesoft db/conf/icse/mobilesoft2019.html#SingletonZSS19

Myoungkyu Song Eli Tilevich Systematic adaptation of dynamically generated source code via domain-specific examples. 112-119 2018 12 IET Softw. 2 https://doi.org/10.1049/iet-sen.2016.0211 https://www.wikidata.org/entity/Q110511662 db/journals/iet-sen/iet-sen12.html#SongT18

Zhiyuan Chen 0006 Hai-Feng Guo Myoungkyu Song Improving regression test efficiency with an awareness of refactoring changes. 174-187 2018 103 Inf. Softw. Technol. https://doi.org/10.1016/j.infsof.2018.07.003 https://www.wikidata.org/entity/Q113316933 db/journals/infsof/infsof103.html#ChenGS18

Zhiyuan Chen 0006 Young-Woo Kwon 0001 Myoungkyu Song Clone refactoring inspection by summarizing clone refactorings and detecting inconsistent changes during software evolution. 2018 30 J. Softw. Evol. Process. 10 https://doi.org/10.1002/smr.1951 db/journals/smr/smr30.html#ChenKS18

Everton L. G. Alves Myoungkyu Song Tiago Massoni Patrícia Duarte de Lima Machado Miryung Kim Refactoring Inspection Support for Manual Refactoring Edits. 365-383 2018 44 IEEE Trans. Software Eng. 4 https://doi.org/10.1109/TSE.2017.2679742 http://doi.ieeecomputersociety.org/10.1109/TSE.2017.2679742 db/journals/tse/tse44.html#AlvesSMMK18

Alexander J. Paul Dylan Lawrence Myoungkyu Song Seung-Hwan Lim Chongle Pan Tae-Hyuk Ahn SORA: Scalable Overlap-graph Reduction Algorithms for Genome Assembly using Apache Spark in the Cloud. 718-723 2018 BIBM https://doi.ieeecomputersociety.org/10.1109/BIBM.2018.8621546 conf/bibm/2018 db/conf/bibm/bibm2018.html#PaulLSLPA18 Samuel Sungmin Cho Myoungkyu Song Christine Julien 0001 Intelligent Information Sharing Among IoT Devices: Models, Strategies, and Language. 107-112 2018 EIT https://doi.org/10.1109/EIT.2018.8500128 conf/eit/2018 db/conf/eit/eit2018.html#ChoSJ18 Alex Fish Thuy Linh Nguyen Myoungkyu Song CloneMap: A Clone-Aware Code Inspection Tool in Evolving Software. 368-372 2018 EIT https://doi.org/10.1109/EIT.2018.8500143 conf/eit/2018 db/conf/eit/eit2018.html#FishNS18 Thuy Linh Nguyen Alex Fish Myoungkyu Song An Empirical Study on Similar Changes in Evolving Software. 560-563 2018 EIT https://doi.org/10.1109/EIT.2018.8500302 conf/eit/2018 db/conf/eit/eit2018.html#NguyenFS18

Myoungkyu Song Young-Woo Kwon 0001 Which Code Changes Should You Review First?: A Code Review Tool to Summarize and Prioritize Important Software Changes. 255-262 2017 4 J. Multim. Inf. Syst. 4 https://doi.org/10.9717/JMIS.2017.4.4.255 db/journals/jmmis/jmmis4.html#Song017

Bo Guo 0004 Myoungkyu Song Interactively Decomposing Composite Changes to Support Code Review and Regression Testing. 118-127 2017 COMPSAC (1) https://doi.org/10.1109/COMPSAC.2017.153 https://doi.ieeecomputersociety.org/10.1109/COMPSAC.2017.153 conf/compsac/2017-1 db/conf/compsac/compsac2017-1.html#GuoS17 Zhiyuan Chen 0006 Maneesh Mohanavilasam Young-Woo Kwon 0001 Myoungkyu Song Tool Support for Managing Clone Refactorings to Facilitate Code Review in Evolving Software. 288-297 2017 COMPSAC (1) https://doi.org/10.1109/COMPSAC.2017.242 https://doi.ieeecomputersociety.org/10.1109/COMPSAC.2017.242 conf/compsac/2017-1 db/conf/compsac/compsac2017-1.html#ChenMKS17 Minh Le Myoungkyu Song Young-Woo Kwon 0001 Enabling Flexible and Efficient Remote Execution in Opportunistic Networks through Message-Oriented Middleware. 979-984 2017 COMPSAC (1) https://doi.org/10.1109/COMPSAC.2017.116 https://doi.ieeecomputersociety.org/10.1109/COMPSAC.2017.116 conf/compsac/2017-1 db/conf/compsac/compsac2017-1.html#LeSK17

Myoungkyu Song Eli Tilevich Reusing metadata across components, applications, and languages. 617-644 2015 98 Sci. Comput. Program. https://doi.org/10.1016/j.scico.2014.09.002 https://www.wikidata.org/entity/Q122190115 db/journals/scp/scp98.html#SongT15

Tianyi Zhang 0001 Myoungkyu Song Joseph Pinedo Miryung Kim Interactive Code Review for Systematic Changes. 111-122 2015 ICSE (1) https://doi.org/10.1109/ICSE.2015.33 https://doi.ieeecomputersociety.org/10.1109/ICSE.2015.33 http://dl.acm.org/citation.cfm?id=2818771 conf/icse/2015-1 db/conf/icse/icse2015-1.html#ZhangSPK15 Everton L. G. Alves Myoungkyu Song Miryung Kim RefDistiller: a refactoring aware code review tool for inspecting manual refactoring edits. 751-754 2014 SIGSOFT FSE https://doi.org/10.1145/2635868.2661674 conf/sigsoft/2014 db/conf/sigsoft/fse2014.html#AlvesSK14 Tianyi Zhang 0001 Myoungkyu Song Miryung Kim Critics: an interactive code review tool for searching and inspecting systematic changes. 755-758 2014 SIGSOFT FSE https://doi.org/10.1145/2635868.2661675 conf/sigsoft/2014 db/conf/sigsoft/fse2014.html#ZhangSK14 Myoungkyu Song Supporting Effective Reuse and Safe Evolution in Metadata-Driven Software Development. 2013 Virginia Tech, Blacksburg, VA, USA http://hdl.handle.net/10919/19369 https://www.base-search.net/Record/be5cbda4a82d5ea02193b2d5ff5af256e729f46d9fc7e6c9b5ca4c3169dbc118 base-search.net (ftvirginiatec:oai:vtechworks.lib.vt.edu:10919/19369) Myoungkyu Song Eli Tilevich TAE-JS: automated enhancement of JavaScript programs by leveraging the Java annotations infrastructure. 13-24 2013 PPPJ https://doi.org/10.1145/2500828.2500830 https://www.wikidata.org/entity/Q131118146 conf/pppj/2013 db/conf/pppj/pppj2013.html#SongT13 Myoungkyu Song Eli Tilevich Reusing non-functional concerns across languages. 227-238 2012 AOSD https://doi.org/10.1145/2162049.2162076 conf/aosd/2012 db/conf/aosd/aosd2012.html#SongT12 Myoungkyu Song Eli Tilevich Metadata invariants: Checking and inferring metadata coding conventions. 694-704 2012 ICSE https://doi.org/10.1109/ICSE.2012.6227148 https://doi.ieeecomputersociety.org/10.1109/ICSE.2012.6227148 http://dl.acm.org/citation.cfm?id=2337305 conf/icse/2012 db/conf/icse/icse2012.html#SongT12 Myoungkyu Song Eli Tilevich Detecting metadata bugs on the fly. 1455-1456 2012 ICSE https://doi.org/10.1109/ICSE.2012.6227067 https://doi.ieeecomputersociety.org/10.1109/ICSE.2012.6227067 http://dl.acm.org/citation.cfm?id=2337450 conf/icse/2012 db/conf/icse/icse2012.html#SongT12a Eli Tilevich Myoungkyu Song Reusable enterprise metadata with pattern-based structural expressions. 25-36 2010 AOSD https://doi.org/10.1145/1739230.1739234 conf/aosd/2010 db/conf/aosd/aosd2010.html#TilevichS10 Dong Kwan Kim Myoungkyu Song Eli Tilevich Calvin J. Ribbens Shawn A. Bohner Dynamic Software Updates for Accelerating Scientific Discovery. 237-247 2009 ICCS (1) https://doi.org/10.1007/978-3-642-01970-8_24 conf/iccS/2009-1 db/conf/iccS/iccS2009-1.html#KimSTRB09 Myoungkyu Song Eli Tilevich Enhancing source-level programming tools with an awareness of transparent program transformations. 301-320 2009 OOPSLA https://doi.org/10.1145/1640089.1640112 https://doi.org/10.1145/1639949.1640112 https://www.wikidata.org/entity/Q131115273 conf/oopsla/2009 db/conf/oopsla/oopsla2009.html#SongT09 Myoungkyu Song Eli Tilevich The anti-goldilocks debugger: helping the average bear debug transparently transformed programs. 811-812 2009 OOPSLA Companion https://doi.org/10.1145/1639950.1640027 https://www.wikidata.org/entity/Q131115272 conf/oopsla/2009c db/conf/oopsla/oopsla2009c.html#SongT09a Myoungkyu Song Eli Tilevich Wesley Tansey Trailblazer: a tool for automated annotation refactoring. 813-814 2009 OOPSLA Companion https://doi.org/10.1145/1639950.1640028 conf/oopsla/2009c db/conf/oopsla/oopsla2009c.html#SongTT09 Tae-Hyuk Ahn Everton L. G. Alves Krishna Teja Ayinala Piyush Basia Shawn A. Bohner Nicholas Caporusso Zhiyuan Chen 0006 Kwok Sun Cheng Samuel Sungmin Cho Parvathi Chundi Adam DeTavernier Vamshi Krishna Epuri Tami Farber Alex Fish Benjamin Gooder Bo Guo 0004 Haifeng GuoHai-Feng Guo Pei-Chi Huang Christine Julien 0001 Dong Kwan Kim Miryung Kim Young-Woo Kwon 0001 Dylan Lawrence Minh Le Tammy Le Seung-Hwan Lim Patrícia Duarte de Lima Machado Shradha Maharjan Tiago Massoni Michael Menard Maneesh Mohanavilasam Hugh Morton Kushal Nallavolu Tommy Nelson Dip Kiran Pradhan Newar Thuy Linh Nguyen Uy Nguyen Kwangsung Oh Chulwoo Pack Chongle Pan Deepak Panda Alexander J. Paul Joseph Pinedo Calvin J. Ribbens Sushma Sakala Clinton Schultz Milan Shahi Ejan Shakya Larry Singleton Harvey P. Siy Leen-Kiat Soh Teukseob Song Mahadevan Subramaniam Wesley Tansey Will Taylor Eli Tilevich Jun Wang Yuchen Wang Zhipeng Wang Meng Xia Xinyu Zeng Tianyi Zhang 0001 Rui Zhao 0005 Xin Zhong