Improving Transformer Performance for French Clinical Notes Classification Using Mixture of Experts on a Limited Dataset

Keyphrases

• French Clinical Notes 100%
• Mixture-of-experts 100%
• Limited Datasets 100%
• Transformer Performance 100%
• Clinical Notes Classification 100%
• Transformer Model 66%
• Transformer 50%
• Computational Resources 50%
• Camembert 33%
• Clinical Text 33%
• Clinical Setting 16%
• Natural Language Processing 16%
• F1 Score 16%
• Training Model 16%
• Computational Demand 16%
• Clinical Narratives 16%
• Clinical Text Classification 16%
• Effective Training 16%
• Low-resource 16%
• Hospital-based 16%
• Sharp Minima 16%
• BERT Model 16%
• Gustave Flaubert 16%
• Hospital Use 16%
• Dual Challenge 16%
• Generalization Gap 16%
• Distil-BERT 16%
• Pre-trained BERT 16%

Computer Science

• Computational Resource 100%
• Transformer Model 100%
• Natural Language Processing 33%
• Text Classification 33%
• Pre-Trained Model 33%
• Clinical Setting 33%
• Bidirectional Encoder Representations From Transformers 33%
• Dual Challenge 33%

Engineering

• Computational Resource 100%
• Limitations 33%
• Natural Language Processing 33%
• Effective Training 33%