Transformer Meets Gated Residual Networks to Enhance PICU’s PPG Artifact Detection Informed by Mutual Information Neural Estimation

Keyphrases

• Transformer 100%
• Artifact Detection 100%
• Mutual Information Neural Estimation 100%
• Pediatric Intensive Care Unit 100%
• Gated Residual Network 100%
• Gated Linear Unit 28%
• Mutual Information 14%
• Attention Mechanism 14%
• Learning Methods 14%
• Activation Function 14%
• Analysis Support 14%
• MLP Neural Network 14%
• Supervised Learning 14%
• LSTM Network 14%
• F1 Score 14%
• Transformer Model 14%
• Annotated Dataset 14%
• Data-limited 14%
• Network Transformers 14%
• Hidden Representation 14%
• Filter Layer 14%
• Constrained Environment 14%
• Transformer Performance 14%
• Sigmoid Function 14%
• Intermediary Layer 14%
• Network Booster 14%
• Residual Network Structure 14%
• CNN Network 14%
• Unannotated Data 14%
• Self-supervised Learning 14%
• Estimation Analysis 14%
• Unsupervised/supervised Learning 14%
• Transformer Attention Mechanism 14%

Computer Science

• Mutual Information 100%
• Residual Neural Network 100%
• Attention (Machine Learning) 28%
• Convolutional Neural Network 14%
• Long Short-Term Memory Network 14%
• Supervised Learning 14%
• Activation Function 14%
• Network Structure 14%
• Self-Supervised Learning 14%
• Data Availability 14%
• Support Analysis 14%
• Constrained Environment 14%
• Transformer Model 14%

Social Sciences

• Pediatrics 100%
• Attention Mechanism 66%
• Learning Method 33%
• Long Short-Term Memory Network 33%
• Convolutional Neural Network 33%
• Self-Supervised Learning 33%
• Transformer Model 33%