Skip to content

Instantly share code, notes, and snippets.

@mikeesto
Created August 15, 2024 04:22
Show Gist options
  • Save mikeesto/29c9cee43f95e0385b67ac83040a499e to your computer and use it in GitHub Desktop.
Save mikeesto/29c9cee43f95e0385b67ac83040a499e to your computer and use it in GitHub Desktop.
Rough whisper benchmarks
MBP M3 Pro 36GB
Transcribing 39:00 min video
1:30 - MLX with distil-large-v3-ggml
1:44 - whisper.cpp with ggml-small.en and flash attention flag (-fa)
1:45 - whisper.cpp with ggml-small.en
1:57 - whisper.cpp with distil-large-v3-ggml and flash attention flag
=====================
3:19 - older version of whisper.cpp with ggml-small.en from earlier in the year - definitely worth compiling new versions
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment