Deep Fuzzy Cognitive Maps for Interpretable Multivariate Time Series Prediction

The Fuzzy Cognitive Map (FCM) is a powerful model for system state prediction and interpretable knowledge representation. Recent years have witnessed the tremendous efforts devoted to enhancing the basic FCM, such as introducing temporal factors, uncertainty or fuzzy rules to improve interpretation, and introducing fuzzy neural networks or Wavelets to improve time series prediction. But how to achieve highprecision yet interpretable prediction in cross-domain real-life applications remains a great challenge. In this paper, we propose a novel FCM extension called Deep FCM for multivariate time series forecasting, in order to take both the advantage of FCM in interpretation and the advantage of deep neural networks in prediction. Specifically, to improve the predictive power, Deep FCM leverages a fully connected neural network to model connections (relationships) among concepts in a system, and a recurrent neural network to model unknown exogenous factors that have influences on system dynamics. Moreover, to foster model interpretability encumbered by the embedded deep structures, a partial derivative-based approach is proposed to measure the connection strengths between concepts in Deep FCM. An Alternate Function Gradient Descent algorithm is then proposed for parameter inference. The effectiveness of Deep FCM is validated over four publicly available datasets with the presence of seven baselines. Deep FCM indeed provides an important clue to building interpretable predictors for real-life applications.