Load Whisper in Triton Inference Server

[Astenseke]

Has anyone tried this successfully?

[outtanames]

Not sure if Triton supports this out of the box, but there's a tutorial on https://github.com/autonomi-ai/nos for running Whisper with a REST API https://docs.nos.run/#audio-transcription-whisper-as-a-service.

[saitejamalyala]

#7847

Has a example using python backend (there are better ways to do it as well).

@Astenseke