LiwTERM-r: A Revised Lightweight Transformer-based Model for Multimodal Skin Lesion Detection Robust to Incomplete Input Luis Antonio de Souza Júnior, André Georghton Cardoso Pacheco, Thiago Oliveira Dos Santos, Wyctor Fogos Da Rocha, Pedro Henrique Bouzon, et al. Journal of the Brazilian Computer Society, 2026 As the most common type of cancer in the world, skin cancer accounts for approximately 30% of all diagnosed tumor-based lesions. Early diagnosis can reduce mortality and prevent disfiguring in different skin regions. With the application of machine learning techniques in recent years, especially deep learning, promising results in this task could be achieved, presenting studies demonstrating that the combination of patients' clinical anamneses and images of the injured lesion is essential for improving the correct classification of skin lesions. Despite that, meaningful use of anamneses with multiple collected images of the same skin lesion is mandatory, requiring further investigation. Thus, this project aims to contribute to developing multimodal machine learning-based models to solve the skin lesion classification problem by employing a lightweight transformer model that is robust to missing clinical information input. As a main hypothesis, models can be fed by multiple images from different sources as input along with clinical anamneses from the patient's historical evaluations, leading to a more factual and trustworthy diagnosis. Our model deals with the not-trivial task of combining images and clinical information concerning the skin lesions in a lightweight transformer architecture that does not demand high computation resources or even all the information from the anamneses but still presents competitive classification results.
TODIM and TOPSIS with Z-numbers Renato A. Krohling, André G. C. Pacheco, Guilherme A. dos Santos Frontiers of Information Technology and Electronic Engineering, 2019
PRISM: a clinically interpretable stepwise framework for multimodal skin cancer diagnosis PHG Bouzon, WF da Rocha, LA de Souza Jr, AGC Pacheco Scientific Reports , 2026 2026
Echoes of power: Investigating geopolitical bias in us and china large language models AGC Pacheco, A Cavalini, G Comarela Humanities and Social Sciences Communications , 2026 2026 Citations: 5
LiwTERM-r: A Revised Lightweight Transformer-based Model for Multimodal Skin Lesion Detection Robust to Incomplete Input LA de Souza Júnior, AGC Pacheco, TO dos Santos, WF da Rocha, ... Journal of the Brazilian Computer Society 32 (1), 305-315 , 2026 2026
MetaBlock-SE: A method to deal with missing metadata in multimodal skin cancer classification PHG Bouzon, WF Da Rocha, LA Souza, AGC Pacheco IEEE Journal of Biomedical and Health Informatics 29 (12), 8855-8862 , 2025 2025 Citations: 3
Dermalyze: uma aplicação para auxílio à triagem de lesões de pele baseado em aprendizado profundo EP Magesk, LA de Souza Júnior, PHL Frasson, AGC Pacheco Brazilian Symposium on Multimedia and the Web (WebMedia), 185-193 , 2025 2025
Colepp: uma ferramenta multiplataforma para coleta de dados de dispositivos vestiveis VM de Jesus, AGC Pacheco arXiv preprint arXiv:2510.15565 , 2025 2025
TransConv: a lightweight architecture based on transformers and convolutional neural networks for adenocarcinoma and Barrett’s esophagus identification LA Souza Jr, AGC Pacheco, AFD Souza, T Oliveira-Santos, C Badue, ... Neural Computing and Applications 37 (20), 15535-15546 , 2025 2025
In the picture: Medical imaging datasets, artifacts, and their living review A Jiménez-Sánchez, NR Avlona, S De Boer, VM Campello, A Feragen, ... Proceedings of the 2025 ACM conference on fairness, accountability, and … , 2025 2025 Citations: 24
Uma Abordagem Baseada em LLMs para Análise de Desinformaçao sobre Vacinas A Cavalini, LF Turi, AGC Pacheco, G Comarela Simpósio Brasileiro de Computação Aplicada à Saúde (SBCAS), 272-283 , 2025 2025
Evaluating Deep Neural Skin Cancer Classifiers With Multiple Images Inputs AS Magalhaes, LA Souza Jr, AGC Pacheco Simpósio Brasileiro de Computação Aplicada à Saúde (SBCAS), 772-782 , 2025 2025 Citations: 1
Anotação de imagens médicas assistida por IA: um estudo sobre segmentação de lesões de pele por não especialistas LM Scaramussa, AGC Pacheco Simpósio Brasileiro de Computação Aplicada à Saúde (SBCAS), 152-163 , 2025 2025
Method and wearable electronic system for predicting the heart rate of a user during a physical activity, and, non-transitory computer readable storage medium AGC PACHECO, FAC CABELLO, OAB Penatti, S Lee, H KIM, D Lee US Patent 12,226,196 , 2025 2025
In the Picture: Medical Imaging Datasets, Artifacts, and their Living Review NR Avlona, S de Boer, VM Campello, A Feragen, E Ferrante, M Ganz, ... 2025
LiwTERM: A lightweight transformer-based model for dermatological multimodal lesion detection LA Souza, AGC Pacheco, GG De Angelo, T Oliveira-Santos, C Palm, ... 2024 37th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), 1-6 , 2024 2024 Citations: 10
DeepCraftFuse: visual and deeply-learnable features work better together for esophageal cancer detection in patients with Barrett’s esophagus LA Souza Jr, AGC Pacheco, LA Passos, MCS Santana, R Mendel, ... Neural Computing and Applications 36 (18), 10445-10459 , 2024 2024 Citations: 3
SADE: Software de Análise Dermatológica-Um sistema de coleta, gerenciamento e triagem de lesões de pele AGC Pacheco, CO Vicente, EP Magesk, GS Lucas, GT Caldana, ... Simpósio Brasileiro de Sistemas Multimídia e Web (WebMedia), 111-114 , 2023 2023 Citations: 1
Towards low-power heart rate estimation based on user’s demographics and activity level for wearables AGC Pacheco, FAC Cabello, AMO Fonoff, PG Rodrigues, OAB Penatti, ... ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and … , 2023 2023 Citations: 6
Learning to Estimate Heart Rate From Accelerometer and User's Demographics During Physical Exercises AGC Pacheco, FAC Cabello, PG Rodrigues, DC Miraldo, VBO Fioravanti, ... IEEE Journal of Biomedical and Health Informatics 28 (9), 5092-5102 , 2023 2023 Citations: 3
Learning multiplane images from single views with self-supervision GSP Carvalho, DC Luvizon, AJ Neto, AGC Pacheco, OAB Penatti The British Machine Vision Conference (BMVC) 2021 , 2021 2021 Citations: 2
Improving deep learning sound events classifiers using gram matrix feature-wise correlations AJ Neto, AGC Pacheco, DC Luvizon ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and … , 2021 2021 Citations: 6
MOST CITED SCHOLAR PUBLICATIONS
PAD-UFES-20: A skin lesion dataset composed of patient data and clinical images collected from smartphones AGC Pacheco, GR Lima, AS Salomao, B Krohling, IP Biral, GG de Angelo, ... Data in brief 32, 106221 , 2020 2020 Citations: 440
A-TOPSIS–an approach based on TOPSIS for ranking evolutionary algorithms RA Krohling, AGC Pacheco Procedia Computer Science 55, 308-317 , 2015 2015 Citations: 302
The impact of patient clinical information on automated skin cancer detection AGC Pacheco, RA Krohling Computers in biology and medicine 116, 103545 , 2020 2020 Citations: 292
An attention-based mechanism to combine images and metadata in deep learning models applied to skin cancer classification AGC Pacheco, RA Krohling IEEE journal of biomedical and health informatics 25 (9), 3554-3563 , 2021 2021 Citations: 271
IF-TODIM: An intuitionistic fuzzy TODIM to multi-criteria decision making RA Krohling, AGC Pacheco, ALT Siviero Knowledge-Based Systems 53, 142-146 , 2013 2013 Citations: 206
Time series prediction using restricted boltzmann machines and backpropagation R Hrasko, AGC Pacheco, RA Krohling Procedia Computer Science 55, 990-999 , 2015 2015 Citations: 99
Skin cancer detection based on deep learning and entropy to detect outlier samples AGC Pacheco, AR Ali, T Trappenberg Medical Image Computing and Computer Assisted Intervention (MICCAI) at Skin … , 2019 2019 Citations: 81
TODIM and TOPSIS with Z-numbers RA Krohling, AGC Pacheco, GA dos Santos Frontiers of Information Technology & Electronic Engineering 20 (2), 283-291 , 2019 2019 Citations: 81
Recent advances in deep learning applied to skin cancer detection AGC Pacheco, RA Krohling Neural Information Processing Systems @ Retrospectives workshop , 2019 2019 Citations: 77
On out-of-distribution detection algorithms with deep neural skin cancer classifiers AGC Pacheco, CS Sastry, T Trappenberg, S Oore, RA Krohling Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern … , 2020 2020 Citations: 65
Restricted Boltzmann machine to determine the input weights for extreme learning machines AGC Pacheco, RA Krohling, CAS da Silva Expert Systems with Applications 96, 77-85 , 2018 2018 Citations: 44
A smartphone based application for skin cancer classification using deep learning with clinical images and lesion information B Krohling, PBC Castro, AGC Pacheco, RA Krohling arXiv preprint arXiv:2104.14353 , 2021 2021 Citations: 33
Aggregation of neural classifiers using Choquet integral with respect to a fuzzy measure AGC Pacheco, RA Krohling Neurocomputing 292, 151-164 , 2018 2018 Citations: 33
An app to detect melanoma using deep learning: An approach to handle imbalanced data based on evolutionary algorithms PBC Castro, B Krohling, AGC Pacheco, RA Krohling 2020 international joint conference on neural networks (IJCNN), 1-6 , 2020 2020 Citations: 29
Skin lesion segmentation using deep learning for images acquired from smartphones GGD Angelo, AGC Pacheco, RA Krohling IEEE International Joint Conference on Neural Networks (IJCNN) , 2019 2019 Citations: 27
Reconhecimento de imagens bidimensionais utilizando Redes Neurais Artificiais G Perelmuter, EV Carrera, M Vellasco, A Pacheco Anais do VIII Sibgrapi, 197-203 , 1995 1995 Citations: 27
Detection of melanoma from skin lesion images using deep learning techniques V Shah, P Autee, P Sonawane 2020 International Conference on Data Science and Engineering (ICDSE), 1-8 , 2020 2020 Citations: 25
Learning dynamic weights for an ensemble of deep models applied to medical imaging classification AGC Pacheco, T Trappenberg, RA Krohling 2020 International Joint Conference on Neural Networks (IJCNN), 1-8 , 2020 2020 Citations: 25
In the picture: Medical imaging datasets, artifacts, and their living review A Jiménez-Sánchez, NR Avlona, S De Boer, VM Campello, A Feragen, ... Proceedings of the 2025 ACM conference on fairness, accountability, and … , 2025 2025 Citations: 24