Application of Machine Learning and Word Embeddings in the Classification of Cancer Diagnosis Using Patient Anamnesis

Andres Alejandro Ramos Magna, HÉCTOR GABRIEL ALLENDE CID, Carla Taramasco, Carlos Becerra, Rosa L. Figueroa

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Currently, one of the main challenges for information systems in healthcare is focused on support for health professionals regarding disease classifications. This work presents an innovative method for a recommendation system for the diagnosis of breast cancer using patient medical histories. In this proposal, techniques of natural language processing (NLP) were implemented on real datasets: one comprised 160, 560 medical histories of anonymous patients from a hospital in Chile for the following categories: breast cancer, cysts and nodules, other cancer, breast cancer surgeries and other diagnoses; and the other dataset was obtained from the MIMIC III dataset. With the application of word-embedding techniques, such as word2vec's skip-gram and BERT, and machine learning techniques, a recommendation system as a tool to support the physician's decision-making was implemented. The obtained results demonstrate that using word embeddings can define a good-quality recommendation system. The results of 20 experiments with 5-fold cross-validation for anamnesis written in Spanish yielded an F1 of 0.980 ± 0.0014 on the classification of 'cancer' versus 'not cancer' and 0.986 ± 0.0014 for 'breast cancer' versus 'other cancer'. Similar results were obtained with the MIMIC III dataset.

Original languageEnglish
Article number9108225
Pages (from-to)106198-106213
Number of pages16
JournalIEEE Access
Volume8
DOIs
StatePublished - 2020
Externally publishedYes

Keywords

  • anamnesis
  • deep learning
  • machine learning
  • Natural language processing (NLP)
  • recommendation system

Fingerprint

Dive into the research topics of 'Application of Machine Learning and Word Embeddings in the Classification of Cancer Diagnosis Using Patient Anamnesis'. Together they form a unique fingerprint.

Cite this