Huang, W and Barnard, A S (2022) Federated data processing and learning for collaboration in the physical sciences. Machine Learning: Science and Technology, 3 (4). 045023. ISSN 2632-2153
Huang_2022_Mach._Learn.__Sci._Technol._3_045023.pdf - Published Version
Download (1MB)
Abstract
Property analysis and prediction is a challenging topic in fields such as chemistry, nanotechnology and materials science, and often suffers from lack of data. Federated learning (FL) is a machine learning (ML) framework that encourages privacy-preserving collaborations between data owners, and potentially overcomes the need to combine data that may contain proprietary information. Combining information from different data sets within the same domain can also produce ML models with more general insight and reduce the impact of the selection bias inherent in small, individual studies. In this paper we propose using horizontal FL to mitigate these data limitation issues and explore the opportunity for data-driven collaboration under these constraints. We also propose FedRed, a new dimensionality reduction method for FL, that allows faster convergence and accounts for differences between individual data sets. The FL pipeline has been tested on a collection of eight different data sets of metallic nanoparticles, and while there are expected losses compared to a combined data set that does not preserve the privacy of the collaborators, we obtained extremely good result compared to local training on individual data sets. We conclude that FL is an effective and efficient method for the physical science domain that could hugely reduce the negative effect of insufficient data.
Item Type: | Article |
---|---|
Subjects: | OA Open Library > Multidisciplinary |
Depositing User: | Unnamed user with email support@oaopenlibrary.com |
Date Deposited: | 14 Jul 2023 11:33 |
Last Modified: | 01 Nov 2023 03:46 |
URI: | http://archive.sdpublishers.com/id/eprint/1245 |