Skip to main content
Version: 1.16.2

Test results

Load testing

Load testing helps evaluate the quality and speed of OMNI Platform operation under a certain load at a given time interval. A test image used is 240 KB (512х512 px) png image.

Test machine specification

CPURAMSSD
    2 x Intel Xeon E5-2683 v4:
  • 16 cores (32 threads)
  • Clockspeed: 2.10 GHz
  • Maximum speed: 3 GHz
128 GB DDR4 2400 ECCSamsung EVO 870 500 GB

Metrics

Metric Name Description
Users Number of parallel requests
Num threads Number of CPU threads in use
RPS Number of requests processed per second
(50%) 50th percentile 50% of requests are completed in no more than this time, in ms
(95%) 95th percentile 95% of requests are completed in no more than this time, in ms
Max Maximum time to process 1 request, in ms
Avg Average time to process 1 request, in ms

Test 1

Test conditions
  • Face recognition method: 12v1000
  • ipvs: enabled
  • Database size: two mln profiles
  • Scalability: load testing of OMNI Platform 1.16.0 uses the following scaling settings:
    • image-api-age-estimator-dep: 8 instances
    • image-api-emotion-estimator-dep: 8 instances
    • image-api-face-detector-liveness-estimator-dep: 8 instances
    • image-api-mask-estimator-dep: 8 instances
    • image-api-face-detector-template-extractor-dep: 16 instances
    • platform-processing-dep: 16 instances
    • other services: 1 instance for each service

Test results

Request*UsersNum_ threadsRPS50%95%MaxAvg
create_profile (create a profile from a face image)110.81200130025001234
16111.41400160021221409
detect (detect a face and estimate facial attributes from a face image)110.91100120012401101
16112.41300150019031290
profiles (get a list of created profiles)114.8190340379209
2301211.61100180044121060
search (search a face in the database by image)110.971000110012011030
21.37720770963726
41.8540570723543
82.2440500635448
16113.71100130028541167
216.398012001526981
418.486010004269868
817.391010003986921
search_by_ sample_id (search a face in the database by sample ID)117.91201502218126
70199.5700770987703
verify (compare a face image with a sample to determine if they belong to the same person)110.91100120012331118
16112.31300150020461304
verify_by_ sample_id (compare two samples to determine if they belong to the same person) 1114.7658824667
2601259.8100014006680926
CONCLUSION

The most time-consuming operation "Search" takes

  • 0.5 seconds for single requests
  • 1 second under a load of 16 parallel requests

/* Detailed information on the API requests specified in the table can be found in API Reference.