{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T15:46:57Z","timestamp":1761580017171,"version":"build-2065373602"},"reference-count":10,"publisher":"Sociedade Brasileira de Computa\u00e7\u00e3o","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>Os modelos de linguagem de grande escala (LLMs) revolucionaram a aquisi\u00e7\u00e3o virtual de informa\u00e7\u00f5es. Os LLMs s\u00e3o amplamente utilizados em diferentes tarefas, dada sua facilidade de manuseio e alcance de t\u00f3picos. Todavia, n\u00e3o \u00e9 poss\u00edvel garantir precis\u00e3o na aprendizagem dos modelos acerca de quest\u00f5es escassamente documentadas, mesmo em se tratando de problem\u00e1ticas relevantes ou \u00fateis ao seu conhecimento, tal como a declara\u00e7\u00e3o de imposto de renda no Brasil. Este trabalho ent\u00e3o avalia a coer\u00eancia de respostas trazidas por essas ferramentas generativas e para isso lhes foram submetidas as perguntas mais frequentes no tema. Assim, os resultados revelam que os LLMs comerciais s\u00e3o convenientes para combater d\u00favidas sobre a DIRPF.<\/jats:p>","DOI":"10.5753\/stil.2025.37872","type":"proceedings-article","created":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T15:42:06Z","timestamp":1761579726000},"page":"688-692","source":"Crossref","is-referenced-by-count":0,"title":["Avaliando Ferramentas de IA Generativa no Conjunto de Perguntas e Respostas da Receita Federal"],"prefix":"10.5753","author":[{"given":"Erick de","family":"Brito","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matheus","family":"Teotonio","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roberto","family":"Lotufo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jayr","family":"Pereira","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"3742","published-online":{"date-parts":[[2025,9,29]]},"reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"Cabello, O. G. and Nakao, S. H. (2021). Complexidade, conformidade e arrecada\u00e7\u00e3o tribut\u00e1ria. Economia e Sociedade, 30(3):1033\u20131050.","DOI":"10.1590\/1982-3533.2021v30n3art10"},{"key":"2","unstructured":"Coneglian, C. S., Torino, E., Segundo, J. E. S., and Vidotti, S. A. B. G. (2024). Intelig\u00eancia artificial generativa e recupera\u00e7\u00e3o da informa\u00e7\u00e3o: Tend\u00eancias e oportunidades de pesquisa. In XXIII ENCONTRO NACIONAL DE PESQUISA E P\u00d3S-GRADUA\u00c7\u00c3O EM CI\u00caNCIA DA INFORMA\u00c7\u00c3O."},{"key":"3","doi-asserted-by":"crossref","unstructured":"Es, S., James, J., Espinosa Anke, L., and Schockaert, S. (2024). RAGAs: Automated evaluation of retrieval augmented generation. In Aletras, N. and De Clercq, O., editors, Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, pages 150\u2013158, St. Julians, Malta. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2024.eacl-demo.16"},{"key":"4","unstructured":"J\u00fanior, J. D., Faria, A., de Oliveira, E. S., de Brito, E., Teotonio, M., Assump\u00e7\u00e3o, A., Carmo, D., Lotufo, R., and Pereira, J. (2025). Br-taxqa-r: A dataset for question answering with references for brazilian personal income tax law, including case law. arXiv preprint arXiv:2505.15916."},{"key":"5","unstructured":"Lin, C.-Y. (2004). ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out, pages 74\u201381, Barcelona, Spain. Association for Computational Linguistics."},{"key":"6","unstructured":"Magalh\u00e3es, B. and Matos, F. (2025). Falsas verdades. o impacto das alucina\u00e7\u00f5es de ia nos processos judiciais administrativos. Revista Eletr\u00f4nica de Direito Processual, 26(2)."},{"key":"7","unstructured":"Maia, A. S. (2017). Declara\u00e7\u00e3o de imposto de renda de pessoas f\u00edsicas: principais dificuldades dos contribuintes."},{"key":"8","doi-asserted-by":"crossref","unstructured":"Maleki, N., Padmanabhan, B., and Dutta, K. (2024). Ai hallucinations: a misnomer worth clarifying. In 2024 IEEE conference on artificial intelligence (CAI), pages 133\u2013138. IEEE.","DOI":"10.1109\/CAI59869.2024.00033"},{"key":"9","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002). Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics, pages 311\u2013318.","DOI":"10.3115\/1073083.1073135"},{"key":"10","unstructured":"Trench, E. E. (2024). Ra\u00e7a, g\u00eanero e outros atributos do contribuinte e probabilidade de cair na \u201cmalha fina\u201d da receita federal."}],"event":{"name":"Simp\u00f3sio Brasileiro de Tecnologia da Informa\u00e7\u00e3o e da Linguagem Humana","location":"Brasil","acronym":"STIL 2025","number":"16"},"container-title":["Anais do XVI Simp\u00f3sio Brasileiro de Tecnologia da Informa\u00e7\u00e3o e da Linguagem Humana (STIL 2025)"],"original-title":[],"link":[{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/sol.sbc.org.br\/index.php\/stil\/article\/download\/37872\/37650","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/sol.sbc.org.br\/index.php\/stil\/article\/download\/37872\/37650","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T15:42:30Z","timestamp":1761579750000},"score":1,"resource":{"primary":{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/sol.sbc.org.br\/index.php\/stil\/article\/view\/37872"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,29]]},"references-count":10,"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.5753\/stil.2025.37872","relation":{},"subject":[],"published":{"date-parts":[[2025,9,29]]}}}