Skip to main content
Version: 1.18.1

Test results

Load testing

Load testing helps evaluate the quality and speed of OMNI Platform operation under a certain load at a given time interval. A test image used is 240 KB (512х512 px) png image.

Test machine specification

CPURAMSSD
    2 x Intel Xeon E5-2683 v4:
  • 16 cores (32 threads)
  • Clockspeed: 2.10 GHz
  • Maximum speed: 3 GHz
128 GB DDR4 2400 ECCSamsung EVO 870 500 GB

Metrics

Metric Name Description
Users Number of parallel requests
Num threads Number of CPU threads in use
RPS Number of requests processed per second
(50%, 60%, ...) 50th, 60th, ... percentile % of requests are completed in no more than this time, in ms
Max Maximum time to process 1 request, in ms
Avg Average time to process 1 request, in ms

Basic load test

Test conditions
  • Face recognition method: 12v1000
  • ipvs: enabled
  • Database size: two mln profiles
  • Scalability: load testing of OMNI Platform 1.18.0 uses the following scaling settings:
    • image-api-age-estimator-dep: 8 instances
    • image-api-emotion-estimator-dep: 8 instances
    • image-api-face-detector-liveness-estimator-dep: 8 instances
    • image-api-mask-estimator-dep: 8 instances
    • image-api-face-detector-template-extractor-dep: 16 instances
    • platform-processing-dep: 16 instances
    • other services: 1 instance for each service

Test results

Request*UsersNum_ threadsRPSAvgMinMax
create_profile (create a profile from a face image)110.910739941273
16111139511933271
detect (detect a face and estimate facial attributes from a face image)1119738861189
16112131610943029
profiles (get a list of created profiles)114.9205157383
230121510663434587
search (search a face in the database by image)110.9610459432140
16112.5127810153807
search_by_ sample_id (search a face in the database by sample ID)116.91451162321
7013321141135277
verify (compare a face image with a sample to determine if they belong to the same person)1119889071148
16112133011163350
verify_by_ sample_id (compare two samples to determine if they belong to the same person) 11166246283
26013806672231120
CONCLUSION

The most time-consuming operation "Search" takes

  • 0.5 seconds for single requests
  • 1 second under a load of 16 parallel requests

/* Detailed information on the API requests specified in the table can be found in API Reference.

Load test for receiving events/activities from cameras

Check typeAvg (ms)Min (ms)Max (ms)RPS
Receiving events50011562688224.8
Receiving activities1372349616966.5
CONCLUSIONS

During the test, OMNI Platform successfully processes the activity reception load at a rate of 1800 activities/sec (300 cameras are connected to OMNI Platform, each of which sends activities at a rate of 6 activities/sec).

The event reception load is processed at a rate of 200 events/sec (200 cameras are connected to OMNI Platform, each of which sends events at a rate of 1 event/sec).