1. Project Overview

Video Behavior Analysis System v4

Introduction to the v4 Series

• With the v4 series of the Video Behavior Analysis System, you can develop any safety behavior detection features you need without having to worry about streaming media audio/video development, encoding and decoding, or interface development. You only need to train your own models and develop your own behavior analysis algorithm plugins to easily implement safety detection scenarios such as perimeter intrusion, fighting, brawling, falling, crowd gathering, leaving posts or sleeping on duty, safety helmet detection, charging station detection, work uniform detection, fatigue detection, traffic congestion, and more.

• (Currently, only the compiled Windows installation package is available. For compilation on other platforms, please contact the author.)

2. Open Source License

Licensed under MIT

3. Screenshots

4. Feature Overview

The v4 series of the Video Behavior Analysis System allows you to develop any safety behavior detection features you need without having to worry about streaming media audio/video development, encoding and decoding, or interface development. You only need to train your own models and develop your own behavior analysis algorithm plugins to easily implement features such as face recognition, vehicle recognition, perimeter intrusion detection, fighting detection, brawling detection, fall detection, crowd gathering detection, leaving posts or sleeping on duty detection, safety helmet detection, charging station detection, work uniform detection, fatigue detection, traffic congestion detection, and more.

5. Tech Stack

Launch the program

• (Compiled installation package) Run VideoAnalyzer.exe directly to launch the entire project. Before starting the project, you can refer to the configuration instructions below.

• (Currently, only the compiled Windows installation package is available. For compilation on other platforms, please contact the author.)

Startup Configuration Instructions

//config.json
{
  "host": "127.0.0.1", // Deployment machine IP address (You can use 127.0.0.1. It is recommended to use ipconfig to obtain the local LAN IP address.)
  "adminPort": 9001,   // Backend management server port
  "analyzerPort": 9002,// Video analysis service port
  "mediaHttpPort": 9003, // Streaming media server port
  "videoAnalyzerPort": 9004, // Startup tool port
  "mediaRtspPort": 9554, // Streaming media server RTSP protocol port
  "mediaSecret": "aqxY9ps21fyhyKNRyYpGvJCTp1JBeGOM",// Streaming media server security code
  "uploadDir": "Admin\\static\\upload", // Root directory for files uploaded through backend management, such as algorithms, audio files, and alarm videos
  "workerConcurrency": 20, // Default supported number of monitored targets (The system will also automatically adjust the supported number of monitored targets during operation.)
  "supportHardwareVideoDecode": false,   // Whether to enable hardware decoding (It is recommended to disable hardware decoding to reserve hardware resources for algorithms.)
  "supportHardwareVideoEncode": false   // Whether to enable hardware encoding (It is recommended to disable hardware encoding to reserve hardware resources for algorithms.)
}

Access Backend Management

• Enter [http://127.0.0.1:9001](http://127.0.0.1:9001) in your browser.

• Default system credentials: Username: admin Password: admin888

Push Streams Using FFmpeg Command Line

// Stream a local file to VideoAnalyzer (This command has not been optimized and may result in high latency.)
ffmpeg -re -stream_loop -1  -i test.mp4  -rtsp_transport tcp -c copy -f rtsp rtsp://127.0.0.1:9554/live/test

// Stream a camera video feed to VideoAnalyzer (This command has been optimized, but some latency still remains. To completely eliminate streaming latency, you can refer to my video:https://space.bilibili.com/487906612）
ffmpeg  -rtsp_transport tcp -i url -fflags nobuffer -max_delay 1 -threads 5  -profile:v high  -preset superfast -tune zerolatency  -an -c:v h264 -crf 25 -s 1280*720   -f rtsp -bf 0  -g 5  -rtsp_transport tcp rtsp://127.0.0.1:9554/live/camera

// Notes
In the data folder under the root directory, I have provided a test.mp4 file for everyone to test and simulate a video stream.