TY - GEN
T1 - Unboxing Default Argument Breaking Changes in Scikit Learn
AU - Montandon, Joao Eduardo
AU - Silva, Luciana Lourdes
AU - Politowski, Cristiano
AU - Boussaidi, Ghizlane El
AU - Valente, Marco Tulio
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Machine Learning (ML) has revolutionized the field of computer software development, enabling data-based predictions and decision-making across several domains. Following modern software development practices, developers use third-party libraries - e.g., Scikit Learn, TensorFlow, and PyTorch - to integrate ML-based functionalities into their applications. Due to the complexity inherent in ML techniques, the models available in the APIs of these tools often require an extensive list of arguments to be set up. Library maintainers overcome this issue by defining default values for most of these arguments so developers can use ML models in their client applications effortlessly. By relying on these default arguments, the clients inadvertently depend on the value defined in these parameters to keep running as expected. We interpret this problem as a semantical breaking change variant, which we named Default Argument Breaking Change (DABC). In this work, we leverage 77 DABCs in Scikit Learn - a well-known ML library - and investigate how 194K client applications are vulnerable to them. Our results show that 72 DABCs (93%) are responsible for exposing 67,747 clients (35%). We also detected that most DABCs (61, 79%) involve APIs used in ML model training and model evaluation stages. Finally, we discuss the importance of managing DABCs in third-party ML libraries and provide insights for developers to mitigate the potential impact of these changes in their applications.
AB - Machine Learning (ML) has revolutionized the field of computer software development, enabling data-based predictions and decision-making across several domains. Following modern software development practices, developers use third-party libraries - e.g., Scikit Learn, TensorFlow, and PyTorch - to integrate ML-based functionalities into their applications. Due to the complexity inherent in ML techniques, the models available in the APIs of these tools often require an extensive list of arguments to be set up. Library maintainers overcome this issue by defining default values for most of these arguments so developers can use ML models in their client applications effortlessly. By relying on these default arguments, the clients inadvertently depend on the value defined in these parameters to keep running as expected. We interpret this problem as a semantical breaking change variant, which we named Default Argument Breaking Change (DABC). In this work, we leverage 77 DABCs in Scikit Learn - a well-known ML library - and investigate how 194K client applications are vulnerable to them. Our results show that 72 DABCs (93%) are responsible for exposing 67,747 clients (35%). We also detected that most DABCs (61, 79%) involve APIs used in ML model training and model evaluation stages. Finally, we discuss the importance of managing DABCs in third-party ML libraries and provide insights for developers to mitigate the potential impact of these changes in their applications.
KW - breaking changes
KW - default arguments
KW - machine learning
KW - python
KW - scikit learn
UR - https://www.scopus.com/pages/publications/85182734340
U2 - 10.1109/SCAM59687.2023.00030
DO - 10.1109/SCAM59687.2023.00030
M3 - Contribution to conference proceedings
AN - SCOPUS:85182734340
T3 - Proceedings - 2023 IEEE 23rd International Working Conference on Source Code Analysis and Manipulation, SCAM 2023
SP - 209
EP - 219
BT - Proceedings - 2023 IEEE 23rd International Working Conference on Source Code Analysis and Manipulation, SCAM 2023
A2 - Moonen, Leon
A2 - Newman, Christian
A2 - Gorla, Alessandra
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 23rd IEEE International Working Conference on Source Code Analysis and Manipulation, SCAM 2023
Y2 - 1 October 2023 through 2 October 2023
ER -