Slow when loading customized backend with mkl

[tz301]

I have a customized backend, which is similiar as kaldi asr but just using cpu. I have run it successfully but it becomes slow obviously (2~3 times slow) and much more cpu usage. I doubt that it's because server thread function call mkl thread function. The customized backend dynamic library will link mkl library installed in system.

I have used pprof to show functions be called as below figures. The first is local run, and the second is run in server, both using the same data for just one inference.

For local run, mkl_blas is called many times. But for the second, omp_get_num_procs is the highest, and mkl_blas is called only few times. Could anyone give some advices?