SUBJECT: Ph.D. Proposal Presentation
   
BY: Tingli Xie
   
TIME: Friday, October 21, 2022, 1:30 p.m.
   
PLACE: GTMI, 201
   
TITLE: Development of Deep Meta-Learning Framework for Cross-Domain Multisensory Systems
   
COMMITTEE: Dr. Seung-Kyum Choi, Chair (ME)
Dr. Roger Jiao (ME)
Dr. Shreyes N. Melkote (ME)
Dr. Fan Zhang (ME)
Dr. Ying Zhang (ECE)
Dr. Pan Zou (AT&T)
 

SUMMARY

Prognostics and health management (PHM) for complex industrial systems is required for cost reduction, maintenance schedules, and reducing system failures. Catastrophic failure usually causes significant damage and may cause injury or fatality, making early and accurate diagnostics of paramount importance. As important parts of industrial systems, the reliability and availability of critical components and machinery are essential to ensure safe and continuous operation in modern industry. With the development of sensor and information technologies, multisensory systems are widely used in the modern industry, which use multiple measurements (e.g., vibratory, electrical, thermal, acoustic, and oil-based data, etc.) to adequately reflect the health condition of critical machinery. As a result, it is necessary to develop intelligent and accurate PHM methods for multisensory systems. In this research, a deep meta-learning framework for cross-domain multisensory systems is investigated, which uses information fusion strategy, meta-learning, and convolution neural networks (CNN). First, to enhance the utilization of multisignal data in CNN-based models, a multisignals-to-RGB-image conversion method is proposed for feature-level information fusion, which uses principal component analysis (PCA) to fuse multisignal data into three-channel red-green-blue (RGB) images for further identification. Second, a novel method called information fusion-based meta-learning (IFML) for cross-domain few-shot problems is proposed, which can not only be generalized to identify abnormal conditions with limited labeled samples, but also be used for different cross-domain scenarios. Third, the open-set meta-learning (OSML) is proposed to enhance model generalization and solve open-set misclassification problems. The effectiveness and generalization of the proposed framework are validated in several industrial datasets consisting of different multisensory systems.