Can I use this lib with onnx but without libtorch?

[Andreybest]

Hey! I trying to do some task with t5 model. But the issue is that I can't put 600mb of libtorch in my project.
Question: Is it possible in this lib to use onnx without downloading libtorch?
Thanks!

[guillaume-be]

Hello @Andreybest ,

Unfortunately the torch dependency is still needed by the library as we use it for the pre/post-processing operations. Making the dependency optional would require re-writing a ndarray (or other) version of all the pipelines. This represents a significant amount of work (especially for the text generation pipelines) and I am not sure to have the capacity in the near future.

Would you be willing to work on such a conversion?

[BB-fat]

Maybe Candle is what u need. @Andreybest