2022
Berghout T, Bentrcia T, Ferrag M-A, Benbouzid M.
A Heterogeneous Federated Transfer Learning Approach with Extreme Aggregation and Speed. Mathematics [Internet]. 2022;10 (19).
Publisher's VersionAbstractFederated learning (FL) is a data-privacy-preserving, decentralized process that allows local edge devices of smart infrastructures to train a collaborative model independently while keeping data localized. FL algorithms, encompassing a well-structured average of the training parameters (e.g., the weights and biases resulting from training-based stochastic gradient descent variants), are subject to many challenges, namely expensive communication, systems heterogeneity, statistical heterogeneity, and privacy concerns. In this context, our paper targets the four aforementioned challenges while focusing on reducing communication and computational costs by involving recursive least squares (RLS) training rules. Accordingly, to the best of our knowledge, this is the first time that the RLS algorithm is modified to completely accommodate non-independent and identically distributed data (non-IID) for federated transfer learning (FTL). Furthermore, this paper also introduces a newly generated dataset capable of emulating such real conditions and of making data investigation available on ordinary commercial computers with quad-core microprocessors and less need for higher computing hardware. Applications of FTL-RLS on the generated data under different levels of complexity closely related to different levels of cardinality lead to a variety of conclusions supporting its performance for future uses.
Berghout T, Bentrcia T, Ferrag M-A, Benbouzid M.
A Heterogeneous Federated Transfer Learning Approach with Extreme Aggregation and Speed. Mathematics [Internet]. 2022;10 (19).
Publisher's VersionAbstractFederated learning (FL) is a data-privacy-preserving, decentralized process that allows local edge devices of smart infrastructures to train a collaborative model independently while keeping data localized. FL algorithms, encompassing a well-structured average of the training parameters (e.g., the weights and biases resulting from training-based stochastic gradient descent variants), are subject to many challenges, namely expensive communication, systems heterogeneity, statistical heterogeneity, and privacy concerns. In this context, our paper targets the four aforementioned challenges while focusing on reducing communication and computational costs by involving recursive least squares (RLS) training rules. Accordingly, to the best of our knowledge, this is the first time that the RLS algorithm is modified to completely accommodate non-independent and identically distributed data (non-IID) for federated transfer learning (FTL). Furthermore, this paper also introduces a newly generated dataset capable of emulating such real conditions and of making data investigation available on ordinary commercial computers with quad-core microprocessors and less need for higher computing hardware. Applications of FTL-RLS on the generated data under different levels of complexity closely related to different levels of cardinality lead to a variety of conclusions supporting its performance for future uses.
Tarek B, Benbouzid M, Amirat Y.
Improving Small-scale Machine Learning with Recurrent Expansion for Fuel Cells Time Series Prognosis. 48th Annual Conference of the IEEE Industrial Electronics Society (IECON 2022) [Internet]. 2022.
Publisher's VersionAbstractThe clean energy conversion characteristics of proton exchange membrane fuel cells (PEMFCs) have given rise to many applications, particularly in transportation. Unfortunately, the commercial application of PEMFCs is hampered by the early deterioration and low durability of the cells. In this case, accurate real-time condition monitoring plays an important role in extending the lifespan of PEMFCs through accurate planning of maintenance tasks. Accordingly, among the widely used modeling tools such as model-driven and data-driven, machine learning has received much attention and has been extensively studied in the literature. Small-scale machine learning (SML) and Deep Learning (DL) are subcategories of machine learning that have been exploited so far. In this context and since SML usually contains non-expansive approximators, this study was dedicated to improving its feature representations for better predictions. Therefore, a recurrent expansion experiment was conducted for several rounds to investigate a linear regression model under time series prognosis of PEMFCs. The results revealed that the prediction performance of SML tools under stationary conditions could be further improved.
Tarek B, Benbouzid M, Amirat Y.
Improving Small-scale Machine Learning with Recurrent Expansion for Fuel Cells Time Series Prognosis. 48th Annual Conference of the IEEE Industrial Electronics Society (IECON 2022) [Internet]. 2022.
Publisher's VersionAbstractThe clean energy conversion characteristics of proton exchange membrane fuel cells (PEMFCs) have given rise to many applications, particularly in transportation. Unfortunately, the commercial application of PEMFCs is hampered by the early deterioration and low durability of the cells. In this case, accurate real-time condition monitoring plays an important role in extending the lifespan of PEMFCs through accurate planning of maintenance tasks. Accordingly, among the widely used modeling tools such as model-driven and data-driven, machine learning has received much attention and has been extensively studied in the literature. Small-scale machine learning (SML) and Deep Learning (DL) are subcategories of machine learning that have been exploited so far. In this context and since SML usually contains non-expansive approximators, this study was dedicated to improving its feature representations for better predictions. Therefore, a recurrent expansion experiment was conducted for several rounds to investigate a linear regression model under time series prognosis of PEMFCs. The results revealed that the prediction performance of SML tools under stationary conditions could be further improved.
Tarek B, Benbouzid M, Amirat Y.
Improving Small-scale Machine Learning with Recurrent Expansion for Fuel Cells Time Series Prognosis. 48th Annual Conference of the IEEE Industrial Electronics Society (IECON 2022) [Internet]. 2022.
Publisher's VersionAbstractThe clean energy conversion characteristics of proton exchange membrane fuel cells (PEMFCs) have given rise to many applications, particularly in transportation. Unfortunately, the commercial application of PEMFCs is hampered by the early deterioration and low durability of the cells. In this case, accurate real-time condition monitoring plays an important role in extending the lifespan of PEMFCs through accurate planning of maintenance tasks. Accordingly, among the widely used modeling tools such as model-driven and data-driven, machine learning has received much attention and has been extensively studied in the literature. Small-scale machine learning (SML) and Deep Learning (DL) are subcategories of machine learning that have been exploited so far. In this context and since SML usually contains non-expansive approximators, this study was dedicated to improving its feature representations for better predictions. Therefore, a recurrent expansion experiment was conducted for several rounds to investigate a linear regression model under time series prognosis of PEMFCs. The results revealed that the prediction performance of SML tools under stationary conditions could be further improved.
Zermane H.
Improving Supervised Machine Learning Models for Face Recognition: a Comparative Study. 4th International Conference on Engineering Science and Technology (ICEST2022) 16th-7th of February. 2022.
Merghem M, Haoues M, Mouss K-N, Dahane M, SENOUSSI A.
Integrated production and maintenance planning in hybrid manufacturing-remanufacturing system with outsourcing opportunities, in
4th International Conference on Industry 4.0 and Smart Manufacturing Procedia Computer Science. ScienceDirect ; 2022.
Merghem M, Haoues M, Mouss K-N, Dahane M, SENOUSSI A.
Integrated production and maintenance planning in hybrid manufacturing-remanufacturing system with outsourcing opportunities, in
4th International Conference on Industry 4.0 and Smart Manufacturing Procedia Computer Science. ScienceDirect ; 2022.
Merghem M, Haoues M, Mouss K-N, Dahane M, SENOUSSI A.
Integrated production and maintenance planning in hybrid manufacturing-remanufacturing system with outsourcing opportunities, in
4th International Conference on Industry 4.0 and Smart Manufacturing Procedia Computer Science. ScienceDirect ; 2022.
Merghem M, Haoues M, Mouss K-N, Dahane M, SENOUSSI A.
Integrated production and maintenance planning in hybrid manufacturing-remanufacturing system with outsourcing opportunities, in
4th International Conference on Industry 4.0 and Smart Manufacturing Procedia Computer Science. ScienceDirect ; 2022.
Merghem M, Haoues M, Mouss K-N, Dahane M, SENOUSSI A.
Integrated production and maintenance planning in hybrid manufacturing-remanufacturing system with outsourcing opportunities, in
4th International Conference on Industry 4.0 and Smart Manufacturing Procedia Computer Science. ScienceDirect ; 2022.
Benaggoune K, Meiling Y, Jemei S, Zerhouni N.
A Knowledge Transfer Approach for Online PEMFC Degradation prediction with Uncertainty Quantification. 12th International Conference on Power, Energy and Electrical Engineering (CPEEE) [Internet]. 2022.
Publisher's VersionAbstractProton Exchange Membrane Fuel Cells (PEMFCs) are a key challenger for the world’s future clean and renewable energy solution. Yet, fuel cells are susceptible to operating conditions and hydrogen impurities, leading to performance loss over time in service. Hence, performance degradation prediction is gaining attention recently for fuel cell system reliability. In this work, we present a knowledge transfer approach for online voltage drop prediction. A dual-path convolution neural network is proposed to extract linearity and non-linearity from historical data and performs multi-steps ahead prediction with uncertainty quantification. Online voltage prediction is then evaluated with and without knowledge transfer using two different PEMFC datasets. Results indicate that our proposed approach with transfer knowledge can predict the voltage drop accurately with a small uncertainty range compared to the conventional approach.
Benaggoune K, Meiling Y, Jemei S, Zerhouni N.
A Knowledge Transfer Approach for Online PEMFC Degradation prediction with Uncertainty Quantification. 12th International Conference on Power, Energy and Electrical Engineering (CPEEE) [Internet]. 2022.
Publisher's VersionAbstractProton Exchange Membrane Fuel Cells (PEMFCs) are a key challenger for the world’s future clean and renewable energy solution. Yet, fuel cells are susceptible to operating conditions and hydrogen impurities, leading to performance loss over time in service. Hence, performance degradation prediction is gaining attention recently for fuel cell system reliability. In this work, we present a knowledge transfer approach for online voltage drop prediction. A dual-path convolution neural network is proposed to extract linearity and non-linearity from historical data and performs multi-steps ahead prediction with uncertainty quantification. Online voltage prediction is then evaluated with and without knowledge transfer using two different PEMFC datasets. Results indicate that our proposed approach with transfer knowledge can predict the voltage drop accurately with a small uncertainty range compared to the conventional approach.
Benaggoune K, Meiling Y, Jemei S, Zerhouni N.
A Knowledge Transfer Approach for Online PEMFC Degradation prediction with Uncertainty Quantification. 12th International Conference on Power, Energy and Electrical Engineering (CPEEE) [Internet]. 2022.
Publisher's VersionAbstractProton Exchange Membrane Fuel Cells (PEMFCs) are a key challenger for the world’s future clean and renewable energy solution. Yet, fuel cells are susceptible to operating conditions and hydrogen impurities, leading to performance loss over time in service. Hence, performance degradation prediction is gaining attention recently for fuel cell system reliability. In this work, we present a knowledge transfer approach for online voltage drop prediction. A dual-path convolution neural network is proposed to extract linearity and non-linearity from historical data and performs multi-steps ahead prediction with uncertainty quantification. Online voltage prediction is then evaluated with and without knowledge transfer using two different PEMFC datasets. Results indicate that our proposed approach with transfer knowledge can predict the voltage drop accurately with a small uncertainty range compared to the conventional approach.
Benaggoune K, Meiling Y, Jemei S, Zerhouni N.
A Knowledge Transfer Approach for Online PEMFC Degradation prediction with Uncertainty Quantification. 12th International Conference on Power, Energy and Electrical Engineering (CPEEE) [Internet]. 2022.
Publisher's VersionAbstractProton Exchange Membrane Fuel Cells (PEMFCs) are a key challenger for the world’s future clean and renewable energy solution. Yet, fuel cells are susceptible to operating conditions and hydrogen impurities, leading to performance loss over time in service. Hence, performance degradation prediction is gaining attention recently for fuel cell system reliability. In this work, we present a knowledge transfer approach for online voltage drop prediction. A dual-path convolution neural network is proposed to extract linearity and non-linearity from historical data and performs multi-steps ahead prediction with uncertainty quantification. Online voltage prediction is then evaluated with and without knowledge transfer using two different PEMFC datasets. Results indicate that our proposed approach with transfer knowledge can predict the voltage drop accurately with a small uncertainty range compared to the conventional approach.
Berghout T, Benbouzid M, Muyeen S-M.
Machine learning for cybersecurity in smart grids: A comprehensive review-based study on methods, solutions, and prospects. International Journal of Critical Infrastructure Protection [Internet]. 2022;38.
Publisher's VersionAbstractIn modern Smart Grids (SGs) ruled by advanced computing and networking technologies, condition monitoring relies on secure cyberphysical connectivity. Due to this connection, a portion of transported data, containing confidential information, must be protected as it is vulnerable and subject to several cyber threats. SG cyberspace adversaries attempt to gain access through networking platforms to commit several criminal activities such as disrupting or malicious manipulation of whole electricity delivery process including generation, distribution, and even customer services such as billing, leading to serious damage, including financial losses and loss of reputation. Therefore, human awareness training and software technologies are necessary precautions to ensure the reliability of data traffic and power transmission. By exploring the available literature, it is undeniable that Machine Learning (ML) has become the latest in the timeline and one of the leading artificial intelligence technologies capable of detecting, identifying, and responding by mitigating adversary attacks in SGs. In this context, the main objective of this paper is to review different ML tools used in recent years for cyberattacks analysis in SGs. It also provides important guidelines on ML model selection as a global solution when building an attack predictive model. A detailed classification is therefore developed with respect to data security triad, i.e., Confidentiality, Integrity, and Availability (CIA) within different types of cyber threats, systems, and datasets. Furthermore, this review highlights the various encountered challenges, drawbacks, and possible solutions as future prospects for ML cybersecurity applications in SGs.
Berghout T, Benbouzid M, Muyeen S-M.
Machine learning for cybersecurity in smart grids: A comprehensive review-based study on methods, solutions, and prospects. International Journal of Critical Infrastructure Protection [Internet]. 2022;38.
Publisher's VersionAbstractIn modern Smart Grids (SGs) ruled by advanced computing and networking technologies, condition monitoring relies on secure cyberphysical connectivity. Due to this connection, a portion of transported data, containing confidential information, must be protected as it is vulnerable and subject to several cyber threats. SG cyberspace adversaries attempt to gain access through networking platforms to commit several criminal activities such as disrupting or malicious manipulation of whole electricity delivery process including generation, distribution, and even customer services such as billing, leading to serious damage, including financial losses and loss of reputation. Therefore, human awareness training and software technologies are necessary precautions to ensure the reliability of data traffic and power transmission. By exploring the available literature, it is undeniable that Machine Learning (ML) has become the latest in the timeline and one of the leading artificial intelligence technologies capable of detecting, identifying, and responding by mitigating adversary attacks in SGs. In this context, the main objective of this paper is to review different ML tools used in recent years for cyberattacks analysis in SGs. It also provides important guidelines on ML model selection as a global solution when building an attack predictive model. A detailed classification is therefore developed with respect to data security triad, i.e., Confidentiality, Integrity, and Availability (CIA) within different types of cyber threats, systems, and datasets. Furthermore, this review highlights the various encountered challenges, drawbacks, and possible solutions as future prospects for ML cybersecurity applications in SGs.
Berghout T, Benbouzid M, Muyeen S-M.
Machine learning for cybersecurity in smart grids: A comprehensive review-based study on methods, solutions, and prospects. International Journal of Critical Infrastructure Protection [Internet]. 2022;38.
Publisher's VersionAbstractIn modern Smart Grids (SGs) ruled by advanced computing and networking technologies, condition monitoring relies on secure cyberphysical connectivity. Due to this connection, a portion of transported data, containing confidential information, must be protected as it is vulnerable and subject to several cyber threats. SG cyberspace adversaries attempt to gain access through networking platforms to commit several criminal activities such as disrupting or malicious manipulation of whole electricity delivery process including generation, distribution, and even customer services such as billing, leading to serious damage, including financial losses and loss of reputation. Therefore, human awareness training and software technologies are necessary precautions to ensure the reliability of data traffic and power transmission. By exploring the available literature, it is undeniable that Machine Learning (ML) has become the latest in the timeline and one of the leading artificial intelligence technologies capable of detecting, identifying, and responding by mitigating adversary attacks in SGs. In this context, the main objective of this paper is to review different ML tools used in recent years for cyberattacks analysis in SGs. It also provides important guidelines on ML model selection as a global solution when building an attack predictive model. A detailed classification is therefore developed with respect to data security triad, i.e., Confidentiality, Integrity, and Availability (CIA) within different types of cyber threats, systems, and datasets. Furthermore, this review highlights the various encountered challenges, drawbacks, and possible solutions as future prospects for ML cybersecurity applications in SGs.
Lahmar H, Dahane M, Mouss N-K, Haoues M.
Multi-objective production planning of new and remanufactured products in hybrid production system. 10th IFAC Conference Onmanufacturing Modelling, Management And Control 22-24 June. 2022.
Lahmar H, Dahane M, Mouss N-K, Haoues M.
Multi-objective production planning of new and remanufactured products in hybrid production system. 10th IFAC Conference Onmanufacturing Modelling, Management And Control 22-24 June. 2022.