Refine
Document Type
- Article (4)
- In Proceedings (1)
Has Fulltext
- no (5)
Is part of the Bibliography
- no (5)
Institute
Aims: Interpretation of continuous EEG is a demanding task that requires the expertise of trained neurologists. However, these experts are not always available in many medical centers. As part of the 2023 George B. Moody PhysioNet Challenge, we developed a deep learning based method for analyzing EEG data of comatose patients and predicting prognosis following cardiac arrest. Methods: Our approach is a two-step pipeline that consists of a prediction model and a decision-making strategy. The prediction model is a residual neural network (ResNet-18) that extracts features and makes a prediction based on a short 5-minute EEG recording. In the second step, a majority vote over multiple predictions made for several EEG recordings of a patient determines the final prognosis. Results: Based on 10-fold cross-validation on the training set, we achieved a true positive rate (TPR) of 0.41 for predicting poor outcome while keeping the false positive rate below 0.05 at 72 hours after recovery of spontaneous circulation. On the official challenge leaderboard, our team ZIB_Visual scored 0.426 TPR. Conclusion: Our approach, while simple to implement and execute, faced overfitting challenges during the official competition phase. In this paper, we discuss our implementation and potential improvements to address these issues.
Accurate diagnosis of heart arrhythmias requires the interpretation of electrocardiograms (ECG), which capture the electrical activity of the heart. Automating this process through machine learning is challenging due to the need for large annotated datasets, which are difficult and costly to collect. To address this issue, transfer learning is often employed, where models are pre-trained on large datasets and fine-tuned for specific ECG classification tasks with limited labeled data. Self-supervised learning has become a widely adopted pre-training method, enabling models to learn meaningful representations from unlabeled datasets. In this work, we explore the joint-embedding predictive architecture (JEPA) for self-supervised learning from ECG data. Unlike invariance-based methods, JEPA does not rely on hand-crafted data augmentations, and unlike generative methods, it predicts latent features rather than reconstructing input data. We create a large unsupervised pre-training dataset by combining ten public ECG databases, amounting to over one million records. We pre-train Vision Transformers using JEPA on this dataset and fine-tune them on various PTB-XL benchmarks. Our results show that JEPA outperforms existing invariance-based and generative approaches, achieving an AUC of 0.945 on the PTB-XL all statements task. JEPA consistently learns the highest quality representations, as demonstrated in frozen evaluations, and proves advantageous for pre-training even in the absence of additional data.
Large-scale perturbations in the microbiome constitution are strongly correlated, whether as a driver or a consequence, with the health and functioning of human physiology. However, understanding the difference in the microbiome profiles of healthy and ill individuals can be complicated due to the large number of complex interactions among microbes. We propose to model these interactions as a time-evolving graph whose nodes are microbes and edges are interactions among them. Motivated by the need to analyse such complex interactions, we develop a method that learns a low-dimensional representation of the time-evolving graph and maintains the dynamics occurring in the high-dimensional space. Through our experiments, we show that we can extract graph features such as clusters of nodes or edges that have the highest impact on the model to learn the low-dimensional representation. This information can be crucial to identify microbes and interactions among them that are strongly correlated with clinical diseases. We conduct our experiments on both synthetic and real-world microbiome datasets.