"translate": "true" results in duplicate predictions

[kylemclaren]

Note

The behaviour occurs when running on Fly.io GPUs via downstream project: https://github.com/fly-apps/cog-whisper. I have not yet replicated it running locally.

curl -X PUT \
     -H "Content-Type: application/json" \
     -d '{
           "input": {
             "audio": "https://some-host.io/some-file.mp3",
             "translate": "true"
           }
         }' \
     http://cog-whisper.host/predictions/test | jq .output.transcription

cog HTTP server logs

2024-07-08T08:07:35Z app[XXXXXXXX] ord [info]{"prediction_id": "1hccnlLIppk", "logger": "cog.server.runner", "timestamp": "2024-07-08T08:07:35.913657Z", "severity": "INFO", "message": "starting prediction"}
2024-07-08T08:07:36Z app[XXXXXXXX] ord [info]Transcribe with large-v3 model.
2024-07-08T08:07:39Z app[XXXXXXXX] ord [info]Detected language: English
2024-07-08T08:07:44Z app[XXXXXXXX] ord [info]  0%|          | 0/156277 [00:00<?, ?frames/s]
2024-07-08T08:07:48Z app[XXXXXXXX] ord [info]  2%|▏         | 3000/156277 [00:04<03:55, 649.96frames/s]
2024-07-08T08:07:52Z app[XXXXXXXX] ord [info]  4%|▍         | 6000/156277 [00:09<03:50, 652.75frames/s]
2024-07-08T08:07:56Z app[XXXXXXXX] ord [info]  6%|▌         | 9000/156277 [00:12<03:27, 710.63frames/s]
2024-07-08T08:08:00Z app[XXXXXXXX] ord [info]  8%|▊         | 12000/156277 [00:16<03:12, 750.46frames/s]
2024-07-08T08:08:04Z app[XXXXXXXX] ord [info] 10%|▉         | 15000/156277 [00:20<03:06, 757.75frames/s]
2024-07-08T08:08:08Z app[XXXXXXXX] ord [info] 11%|█▏        | 17900/156277 [00:24<03:06, 740.32frames/s]
2024-07-08T08:08:11Z app[XXXXXXXX] ord [info] 13%|█▎        | 20800/156277 [00:28<03:03, 737.78frames/s]
2024-07-08T08:08:15Z app[XXXXXXXX] ord [info] 15%|█▌        | 23700/156277 [00:31<02:50, 778.78frames/s]
2024-07-08T08:08:18Z app[XXXXXXXX] ord [info] 17%|█▋        | 26600/156277 [00:36<02:53, 749.44frames/s]
2024-07-08T08:08:23Z app[XXXXXXXX] ord [info] 19%|█▊        | 29100/156277 [00:38<02:40, 792.06frames/s]
2024-07-08T08:08:39Z app[XXXXXXXX] ord [info] 21%|██        | 32100/156277 [00:43<02:55, 708.80frames/s]
2024-07-08T08:08:42Z app[XXXXXXXX] ord [info] 21%|██        | 32100/156277 [01:00<02:55, 708.80frames/s]
2024-07-08T08:08:46Z app[XXXXXXXX] ord [info] 22%|██▏       | 35000/156277 [01:02<06:02, 334.44frames/s]
2024-07-08T08:08:49Z app[XXXXXXXX] ord [info] 24%|██▍       | 37800/156277 [01:06<04:57, 398.14frames/s]
2024-07-08T08:08:52Z app[XXXXXXXX] ord [info] 26%|██▌       | 40600/156277 [01:09<04:01, 478.18frames/s]
2024-07-08T08:08:55Z app[XXXXXXXX] ord [info] 28%|██▊       | 43500/156277 [01:13<03:21, 560.15frames/s]
2024-07-08T08:08:59Z app[XXXXXXXX] ord [info] 30%|██▉       | 46400/156277 [01:16<02:55, 627.74frames/s]
2024-07-08T08:09:02Z app[XXXXXXXX] ord [info] 31%|███▏      | 49100/156277 [01:19<02:38, 676.60frames/s]
2024-07-08T08:09:06Z app[XXXXXXXX] ord [info] 33%|███▎      | 52000/156277 [01:23<02:28, 700.92frames/s]
2024-07-08T08:09:10Z app[XXXXXXXX] ord [info] 35%|███▌      | 55000/156277 [01:27<02:18, 731.55frames/s]
2024-07-08T08:09:14Z app[XXXXXXXX] ord [info] 37%|███▋      | 58000/156277 [01:30<02:08, 762.66frames/s]
2024-07-08T08:09:17Z app[XXXXXXXX] ord [info] 39%|███▉      | 60800/156277 [01:34<02:07, 750.83frames/s]
2024-07-08T08:09:21Z app[XXXXXXXX] ord [info] 41%|████      | 63800/156277 [01:38<02:01, 759.53frames/s]
2024-07-08T08:09:24Z app[XXXXXXXX] ord [info] 43%|████▎     | 66800/156277 [01:42<01:56, 769.07frames/s]
2024-07-08T08:09:29Z app[XXXXXXXX] ord [info] 45%|████▍     | 69700/156277 [01:45<01:46, 810.29frames/s]
2024-07-08T08:09:32Z app[XXXXXXXX] ord [info] 47%|████▋     | 72700/156277 [01:49<01:47, 778.00frames/s]
2024-07-08T08:09:37Z app[XXXXXXXX] ord [info] 48%|████▊     | 75200/156277 [01:52<01:46, 764.01frames/s]
2024-07-08T08:09:49Z app[XXXXXXXX] ord [info] 50%|█████     | 78200/156277 [01:57<01:48, 720.92frames/s]
2024-07-08T08:09:56Z app[XXXXXXXX] ord [info] 50%|█████     | 78200/156277 [02:10<01:48, 720.92frames/s]
2024-07-08T08:09:59Z app[XXXXXXXX] ord [info] 52%|█████▏    | 81200/156277 [02:16<03:39, 342.68frames/s]
2024-07-08T08:10:04Z app[XXXXXXXX] ord [info] 54%|█████▍    | 84100/156277 [02:20<02:54, 414.04frames/s]
2024-07-08T08:10:08Z app[XXXXXXXX] ord [info] 56%|█████▌    | 87100/156277 [02:24<02:26, 471.77frames/s]
2024-07-08T08:10:19Z app[XXXXXXXX] ord [info] 58%|█████▊    | 90100/156277 [02:28<02:04, 530.70frames/s]
2024-07-08T08:10:23Z app[XXXXXXXX] ord [info] 60%|█████▉    | 93100/156277 [02:39<02:33, 410.90frames/s]
2024-07-08T08:10:27Z app[XXXXXXXX] ord [info] 61%|██████▏   | 96000/156277 [02:44<02:10, 463.47frames/s]
2024-07-08T08:10:31Z app[XXXXXXXX] ord [info] 63%|██████▎   | 99000/156277 [02:47<01:48, 527.99frames/s]
2024-07-08T08:10:35Z app[XXXXXXXX] ord [info] 65%|██████▌   | 102000/156277 [02:52<01:35, 568.52frames/s]
2024-07-08T08:10:38Z app[XXXXXXXX] ord [info] 67%|██████▋   | 105000/156277 [02:56<01:23, 614.66frames/s]
2024-07-08T08:10:42Z app[XXXXXXXX] ord [info] 69%|██████▉   | 107800/156277 [02:59<01:10, 685.91frames/s]
2024-07-08T08:10:45Z app[XXXXXXXX] ord [info] 71%|███████   | 110700/156277 [03:02<01:02, 726.57frames/s]
2024-07-08T08:10:48Z app[XXXXXXXX] ord [info] 73%|███████▎  | 113600/156277 [03:05<00:54, 787.47frames/s]
2024-07-08T08:10:51Z app[XXXXXXXX] ord [info] 74%|███████▍  | 116300/156277 [03:08<00:50, 796.10frames/s]
2024-07-08T08:10:55Z app[XXXXXXXX] ord [info] 76%|███████▋  | 119300/156277 [03:12<00:44, 828.17frames/s]
2024-07-08T08:10:58Z app[XXXXXXXX] ord [info] 78%|███████▊  | 122300/156277 [03:15<00:41, 819.92frames/s]
2024-07-08T08:11:01Z app[XXXXXXXX] ord [info] 80%|████████  | 125300/156277 [03:19<00:36, 840.03frames/s]
2024-07-08T08:11:05Z app[XXXXXXXX] ord [info] 82%|████████▏ | 128300/156277 [03:21<00:30, 911.54frames/s]
2024-07-08T08:11:08Z app[XXXXXXXX] ord [info] 84%|████████▍ | 131200/156277 [03:25<00:28, 870.52frames/s]
2024-07-08T08:11:12Z app[XXXXXXXX] ord [info] 86%|████████▌ | 134200/156277 [03:29<00:26, 842.06frames/s]
2024-07-08T08:11:16Z app[XXXXXXXX] ord [info] 88%|████████▊ | 137100/156277 [03:33<00:23, 828.49frames/s]
2024-07-08T08:11:19Z app[XXXXXXXX] ord [info] 90%|████████▉ | 140000/156277 [03:36<00:19, 831.64frames/s]
2024-07-08T08:11:23Z app[XXXXXXXX] ord [info] 91%|█████████▏| 142900/156277 [03:40<00:16, 801.16frames/s]
2024-07-08T08:11:26Z app[XXXXXXXX] ord [info] 93%|█████████▎| 145900/156277 [03:44<00:13, 789.49frames/s]
2024-07-08T08:11:31Z app[XXXXXXXX] ord [info] 95%|█████████▌| 148900/156277 [03:47<00:08, 847.24frames/s]
2024-07-08T08:11:35Z app[XXXXXXXX] ord [info] 97%|█████████▋| 151900/156277 [03:52<00:05, 766.53frames/s]
2024-07-08T08:11:37Z app[XXXXXXXX] ord [info] 99%|█████████▉| 154900/156277 [03:56<00:01, 756.03frames/s]
2024-07-08T08:11:37Z app[XXXXXXXX] ord [info]100%|██████████| 156277/156277 [03:57<00:00, 766.51frames/s]
2024-07-08T08:11:37Z app[XXXXXXXX] ord [info]100%|██████████| 156277/156277 [03:57<00:00, 657.15frames/s]
2024-07-08T08:11:40Z app[XXXXXXXX] ord [info]Detected language: English
2024-07-08T08:11:44Z app[XXXXXXXX] ord [info]  0%|          | 0/156277 [00:00<?, ?frames/s]
2024-07-08T08:11:50Z app[XXXXXXXX] ord [info]  2%|▏         | 2736/156277 [00:04<04:16, 597.82frames/s]
2024-07-08T08:11:54Z app[XXXXXXXX] ord [info]  4%|▎         | 5736/156277 [00:10<04:29, 558.71frames/s]
2024-07-08T08:11:58Z app[XXXXXXXX] ord [info]  6%|▌         | 8686/156277 [00:14<04:00, 614.37frames/s]
2024-07-08T08:12:02Z app[XXXXXXXX] ord [info]  7%|▋         | 11674/156277 [00:18<03:40, 656.86frames/s]
2024-07-08T08:12:07Z app[XXXXXXXX] ord [info]  9%|▉         | 14596/156277 [00:22<03:32, 667.57frames/s]
2024-07-08T08:12:11Z app[XXXXXXXX] ord [info] 11%|█▏        | 17590/156277 [00:27<03:31, 656.11frames/s]
2024-07-08T08:12:15Z app[XXXXXXXX] ord [info] 13%|█▎        | 20590/156277 [00:31<03:22, 669.95frames/s]
2024-07-08T08:12:20Z app[XXXXXXXX] ord [info] 15%|█▌        | 23590/156277 [00:35<03:08, 702.15frames/s]
2024-07-08T08:12:23Z app[XXXXXXXX] ord [info] 17%|█▋        | 26590/156277 [00:40<03:11, 676.62frames/s]