Dr. Qirong Mao

Professor, School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang.

Qirong received her MS and PhD degree in Computer Science and Technology from Jiangsu University, Zhenjiang, P. R. China in 2002 and 2009. She worked for one year at the Wayne State University and the University of Michigan as a visiting scholar advised by Dr. Ming Dong. She is currently a professor of the School of Computer Science and Communication Engineering, Jiangsu University.

Research Overview

Her research interests include affective computing, speech processing, pattern recognition, and multimedia analysis. Her research is supported by the Key Project of National Science Foundation of China (NSFC), Jiangsu province, and the Education Department of Jiangsu province. She has published over 50 technical articles, some of them in premium journals and conferences such as ACM Multimedia, CVPR, ICME, IEEE Transactions on Multimedia, Speech Communication, ICASSP etc.. She is a member of the IEEE.

Professional Service

    Program Committee / Reviewer:

    • MIPR: 2018
    • BIGMM: 2018
    • ICME:2017

    Journal Reviewer:

    • IEEE Transactions on Affective Computing (IEEE-TAC)
    • Neural Networks (NEUNET)
    • IEEE Transactions on Audio, Speech and Language Processing (IEEE-TASL)
    • ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
    • SCIENCE CHINA Information Sciences
    • Smart Health
    • Proceedings of the IEEE

    a senior member of the China Computer Federation

    a member of the IEEE and the ACM

I am looking for highly motivated Post doc./Phd students with strong background in Multimedia Analysis, Speech Processing, Programming, and Artificial Intelligence. We also warmly welcome undergraduate students who are interested in my research to join us as research assistant. Please feel free to contact me via emails on the page bottom.

News

  • New! [2019.10.23]. Our paper “Learning Disentanglement Representation for Acoustic Event Detection” has been represented on ACM Multimedia2019. Congratulations Lijian!
  • New! [2019.09.23] Our paper “Triple attention network for sentimental visual question answering” has been accepted by Computer Vision and Image Understanding. Congratulations Ruwa!
  • New![2019.09.30] My Phd student Ling Zhou and Master student Qing Zhu received China National Scholarships 2019. Congratulations Ling and Qing!
  • New![2019.07.22]. Our paper: “Cross-Database Micro-Expression Recognition: A Style Aggregated and Attention Transfer Approach” has been represented in IEEE International Conference on Multimedia and Expo Workshops. Congratulations Ling!
  • New![2019.07.06] My PhD student, Feifei Zhang, successfully finished her PhD defense. She will join NLPR, Institute of Automation,Chinese Academy of Sciences as a Postdoctoral. Congratulations Feifei!
  • New![2019.07.06] My PhD student, Nelson Ruwa, successfully finished his PhD defense. Congratulations Ruwa!
  • New![2019.06.11]. Our paper “Dual Exclusive Attentive Transfer for Unsupervised Deep Convolutional Domain Adaptation in Speech Emotion Recognition” has been accepted by IEEE Access. Congratulations Elias!
  • New![2019.06.10]. My master student, Lijian Gao received the special offer from Nanjing Fenghuo Software Technology Co., Ltd. Congratulations Lijian!
  • New![2019.05.14]. My PhD student, Ling Zhou ranked the third in the Micro-Expression Grand Challenge 2019. Congratulations Ling!
  • New![2019.04.09] My PhD student, Feifei Zhang has supported by 2019 postdoctoral innovation talent plan. Congratulations Feifei!
  • New![2019.03.20]. Our paper: “An emotion-based responding model for natural language conversation” has been published on World Wide Web. Congratulations Feng!
  • New! [2019.02.22]. Our paper: “Mood-Aware Visual Question Answering” has been published in Neuro Computing. Congratulations Ruwa!
  • New! [2018.12.12]. Our group are supported by the Key Project of National Natural Science Foundation of China. Congratulations!
  • New![2018.11.20]. Our paper: “Cascaded Multi-level Transformed Dirichlet Process for Multi-pose Facial Expression Recognition” has been published on The Computer Journal. Congratulations Feifei!
  • New![2018.10.24]. Our paper: “Facial Expression Recognition in the Wild: A Cycle-Consistent Adversarial Attention Transfer Approach” has been represented on the Proc of 2018 ACM Multimedia Conference on Multimedia Conference (ACM Multimedia2018). Congratulations Feifei!
  • New![2018.06.22]. Our paper: “Joint Pose and Expression Modeling for Facial Expression Recognition” has been represented on the Proc. of the IEEE Conference on Computer Vision and Pattern Recognition 2018(CVPR2018). Congratulations Feifei!
  • New![2018.04.10]. Our paper: “Spatially Coherent Feature Learning for Pose-Invariant Facial Expression Recognition” has been published on ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM). Congratulations Feifei!

Publications

    2019

    • Lijian Gao, Qirong Mao(*), Yu Jin, Ming Dong. On Learning Disentanglement Representation for Acoustic Event Detection. ACM International Conference on Multimedia, 2019, Nice, France.
    • Nelson Ruwa, Qirong Mao, Liangjun Wang, Jianping Gou, Ming Dong. Mood-Aware Visual Question Answering, Neuro Computing, 2019, 330(22): 305-316.
    • Nelson Ruwa,Qirong Mao, Hongjie Jia, Ming Dong. Triple attention network for sentimental visual question answering, Computer Vision and Image Understanding, 2019, (189), 1-10.
    • Elias Nii Noi Ocquaye, Qirong Mao, Heping Song, Guopeng Xu, Yanfei Xue. Dual Exclusive Attentive Transfer for Unsupervised Deep Convolutional Domain Adaptation in Speech Emotion Recognition, IEEE Access, 2019, 7: 93847-93857.
    • Feng Liu, Qirong Mao, Liangjun Wang, Nelson Ruwa, Jianping Gou, Yongzhao Zhan: An emotion-based responding model for natural language conversation. World Wide Web 22(2): 843-861 (2019).
    • Ling Zhou, Qirong Mao(*), Luoyang Xue, Dual-inception network for cross-database micro-expression recognition, Proc.-14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019, May 2019.
    • Ling Zhou,Qirong Mao(*), Luoyang Xue. Cross-Database Micro-Expression Recognition: A Style Aggregated and Attention Transfer Approach, Proceedings - 2019 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2019, p 102-107.

    2018

    • Feifei Zhang, Tianzhu Zhang, Qirong Mao, Changsheng Xu, et al. Joint Pose and Expression Modeling for Facial Expression Recognition. Proc. of the IEEE Conference on Computer Vision and Pattern Recognition. 2018: 3359-3368.
    • Feifei Zhang, Tianzhu Zhang, Qirong Mao et al. Facial Expression Recognition in the Wild: A Cycle-Consistent Adversarial Attention Transfer Approach. 2018 ACM Multimedia Conference on Multimedia Conference. ACM, 2018: 126-135.
    • Qirong Mao , Feifei Zhang, Liangjun Wang, Sidian Luo, Ming Dong. Cascaded Multi-level Transformed Dirichlet Process for Multi-pose Facial Expression Recognition. The Computer Journal, 2018, 11(61): 1605–1619.
    • Feifei Zhang, Qirong Mao , Xiangjun Shen, Yongzhao Zhan, Ming Dong, et al. Spatially Coherent Feature Learning for Pose-Invariant Facial Expression Recognition. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2018, 14(1s): 27.
    • Elias Ocquaye, Qirong Mao, Guopeng Xu, Yanfei Xue. Coupled Unsupervised Deep Convolutional Domain Adaptation for Speech Emotion Recognition, 2018 Fourth IEEE International Conference on Multimedia Big Data (BigMM), 2018.
    • Nelson Ruwa,Qirong Mao, Liangjun Wang, Ming Dong. Affective Visual Question Answering Network. MIPR, 2018: 170-173.

    2017 and old

    • Qirong Mao, Qiyu Rao, Yongbin Yu, Ming Dong. Hierarchical Bayesian Theme Models for Multipose Facial Expression Recognition, IEEE Transactions on Multimedia, 2017, 19(4):861 – 873.
    • Qirong Mao, Ming Dong, Zhengwei Huang, Yongzhao Zhan, Learning Salient Features for Speech Emotion Recognition Using Convolutional Neural Networks, IEEE Transactions on Multimedia, 2014, 16(8): 2203-2213.
    • Qirong Mao, Guopeng Xu, Wentao Xue, Jianping Gou, Yongzhao Zhan. Learning Emotion-discriminative and Domain-invariant Features for Domain Adaptation in Speech Emotion Recognition, Speech Communication, 2017, 93:1-12.
    • Feifei Zhang,Qirong Mao, Ming Dong, Yongzhao Zhan, Multi-pose Facial Expression Recognition Using Transformed Dirichlet Process, Proc. of the 2016 ACM on Multimedia, Amsterdam, The Netherlands, 2016,.10. 15 – 19.
    • Zhengwei Huang,Ming Dong, Qirong Mao,Yongzhao Zhan, Speech Emotion Recognition Using CNN. Proc. of the 22th ACM International Conference on Multimedia,Orlando, FL, USA.,2014.11.3-2014.11.7.
    • Qirong Mao(#)(*), Xinyu Pan, Yongzhao Zhan, Using Kinect for real-time emotion recognition via facial expressions,Frontiers of Information Technology & Electronic Engineering, 2015, 16(4): 272-282.
    • Zhengwei Huang, Wentao Xue,Qirong Mao, Yongzhao Zhan. Unsupervised domain adaptation for speech emotion recognition using PCANet. Multimedia Tools Applications. 2017,76(5): 6785-6799.
    • Qirong Mao(#)(*), Xiaolei Zhao, Zhengwei Huang, Yongzhao Zhan, Speaker- independent speech emotion recognition by fusion of functional and ccompanying paralanguage features, Journal of Zhejiang University-Science C(Computers and Electronics), 2013, 14(7):573-582.
    • Feifei Zhang, Yongbin Yu, Qirong Mao(*), Yongzhao Zhan. Pose-robust Feature Learning for Facial Expression Recognition, Frontiers of Computer Science in China, 2016, 10(5): 1-13.
    • Zhengwei Huang(#), Wentao Xue, Qirong Mao(*), Yongzhao Zhan, Speech emotion recognition with unsupervised feature learning, Frontiers of Information Technology & Electronic Engineering, 2015, 16(5): 358-366.
    • Qirong Mao(#*), Suli Hu, Haihe Wang, Yongzhao Zhan, A Semi-Supervised Recognition Method Based on Probability Distance Manifold Learning and Graph-Model, Journal of Computational & Theoretical Nanoscience, 2014, 11(2):303-309.
    • Li Wang,Qirong Mao(*), The Dimensional Emotion Prediction of Multiple Cues and Modalities Using Improved KNN algorithm, Information & Computational Science, 2014,16(1): 5707-5716.
    • Qirong Mao(#)(*),Wentao Xue,Qiyu Rao,Feifei Zhang,Yongzhao Zhan, Domain Adaption for Speech Emotion Recognition by Sharing Priors Between Related Sources and Target. Proc. of the 41st IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2016), Shanghai, 2016.3.20-2016.3.25.
    • Qiyu Rao(#),Xing Qu,Qirong Mao(*),Yongzhao Zhan, Multi-pose facial expression recognition based on SURF boosting, Proc. of 2015 International Conference on Affective Computing and Intelligent Interaction (ACII),Xi'an China,2015.9.21-2015.9.24.
    • Wentao Xue(#),Zhengwei Huang,Luo Xin,Qirong Mao(*), Learning speech emotion features by joint disentangling-discrimination, Proc. of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII),Xi’an,2015.9.21-2015.9.24.
    • Ebenezer, Owusu, Yongzhao Zhan(*), Qirong Mao. A neural-AdaBoost based facial expression recognition system,Expert Systems with Applications, 2014, 41(7):3383-3390.
    • Owusu, Ebenezer, Yonzhao Zhan,Qirong Mao. An SVM-AdaBoost facial expression recognition system,Applied Intelligence,2014,40(3):536-545.
    • Xiaobo Chen, Jian Yang(*), Qirong Mao. Regularized least squares fisher linear discriminant with applications to image recognition,Neurocomputing,2013,122:512-534.

Funding

  • Speaker Recognition and Keywords-related Information Retrieval in Complex Conversation Environment
    supported by the Key Project of National Natural Science Foundation of China
    Jan. 2019 - Dec. 2022, PI
  • Complex Emotion Discovery and Analysis from Big Audio-vision Data
    supported by the General Project of National Natural Science Foundation of China
    Jan. 2017 - Dec. 2020, PI
  • sponsored by Qing Lan Talent Program of Jiangsu Province
    Jun. 2018-May. 2021, PI

Teaching

  • Operating System
  • Machine Learning
  • (Advanced) Human Computer Interaction
  • Introduction to intelligent science and technology

Contact me

Office: 515, School of Computer Science and Communication Engineering Building
                 301,Xuefu Road, Jingkou District,
                 Zhenjiang, Jiangsu, China, 212013

Email: mao_qr@ujs.edu.cn