Basic Modules | Description |
Activation Module | The module is responsible for Agent activation. |
Camera Handler | The module splits video streams from cameras or video files into frames and prepares them for processing. |
Human Process Handler | The results of processing human faces and bodies are submitted to the Human Process Handler, where they are converted into agent processes and events for subsequent transfer to OMNI Platform or an external service via webhooks/MQTT. |
Body Frame Processing Modules | Description |
Body Detector Processing Block | The module detects human bodies in frames. |
Byte Track Processing Block | The module implements the Byte Track algorithm to improve the detector quality. |
View Transform Handler | The module transfers the coordinates of people detections from the camera to the map. |
Multistream Mapping Handler | The module combines the position of detections on the map from different cameras. |
Embeddings Processing Block | The module creates embeddings from body crops. Embedding means a vector representation of the detected body. |
Reidentification Handler | The module forms a person's track and provides reidentification. During the detection process, each frame is assigned a unique track_id. If the same person is identified on a sequence of frames, the track_id of all related frames are changed to the track_id of the first frame of this person. |
Body Track Handler | The module organizes and processes the ways people move on frames (tracking). |
Hpe Resnet V1D Processing Block | An internal component of HAR pipeline that determines the position of the human skeleton on the frame. |
Har Container Processing Block | The module aggregates the positions of the human skeleton in time into a common container. |
Har Pose C3D Processing Block | An internal component of HAR pipeline that specifies the class of person's position. |
Har Hll Processing Block | The module detects an action. |
Face Frame Processing Modules | Description |
Videoworker Callbacks Handler | The module detects human faces. |
Videoworker Samplify Handler | The module converts detections into a convenient sample format. |
Face Recognition Attributes Splitter | The module selects a best shot in the face track. |
Face Recognizer | The module generates a biometric template. |
Matcher Module | The module searches for a face template in the database. |
Coalesce Facerec Attributes | The module combines matching and tracking results. |
Face Track Handler | The module estimates face attributes in the frame (gender, age, emotions, liveness, mask presence), searches for similar faces in the agent and platform databases (via the Database Sync Handler). If there are matches with the database, the ID of the image from the database is also added to the processing result. |
Attentions Handler | The module estimates human attention (if the person in the frame is looking at the camera). |
Infrastructure Modules | Description |
Webhooks Handler | The module sends Agent processes via webhooks to an external service. |
Server Connection Handler | The module transfers Agent processes to OMNI Platform. |
Webhook Data Projection Handler | The module that projects data into a JSON-like document for subsequent transmission via webhooks. |
Server Data Projection Handler | The module that projects data into a JSON-like document for subsequent transfer to the OMNI Platform. |
Database Sync Handler | The module synchronizes the local database with OMNI Platform database. |
Reconfiguration Handler | The module provides access to configuration files and allows to reconfigure agent without app restart. |
Preview Handler | The module creates previews (frames from the camera with rendered detections, submitted to the web interface of OMNI Agent). |
Frontend Handler | The module manages the agent as a web app. |
External Process Handler | The module brings the signals of the beginning and end of external events to an interval form (processes). |
Http Redirection Module | The module redirects requests to the platform server. |
Multisource Handler | The module creates a pipeline of processing modules for each new videostream. |
Trace Handler | The module collects traces (logs) from Body Detector. |
Custom Resources Provider | The module provides information about the number of visible people and frames from the camera through the internal API. |
MQTT Data Projection Handler | The module projects process data for subsequent sending via a local MQTT queue. |
MQTT Handler | The module sends data to a local queue. |
Universal Best Shot Sender | The module sends detection data in Hikvision data format. |