Evaluation of operation state for operators in NPP Main control room using human behavior recognition

Bowen Zou, Akio Gofuku

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)


The cognitive state of the main control room (MCR) operator is the state of cognitive progress. This paper proposes a video analysis method to assist in the analysis of the operation state. A behavioral coding method is presented for the feature extraction of the MCR operator, and the time-line analysis method is used to continuously sample the operator’s postures and actions. OpenPose algorithm and ST-GCN method are used for the recognition of the operator’s behavior. The level of consciousness and cognition is analyzed based on the operator’s body language and used to evaluate the level of mental stress in performance shaping factors (PSF). A case is presented for the feasibility analysis of the operation state evaluation method. The results of the video analysis help recognize the operator’s bad or error behavior and improve the operator’s operation state.

Original languageEnglish
Pages (from-to)21809-21821
Number of pages13
JournalMultimedia Tools and Applications
Issue number14
Publication statusPublished - Jun 2021


  • Behavioral coding analysis
  • Human behavior recognition
  • Operation state evaluation

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications


Dive into the research topics of 'Evaluation of operation state for operators in NPP Main control room using human behavior recognition'. Together they form a unique fingerprint.

Cite this