Skip to content

Start of Whisper.cpp Delphi Bindings #3019

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
peardox opened this issue Apr 8, 2025 · 5 comments
Open

Start of Whisper.cpp Delphi Bindings #3019

peardox opened this issue Apr 8, 2025 · 5 comments

Comments

@peardox
Copy link

peardox commented Apr 8, 2025

Only really been working on the Pascal part of this for about half a week and real work started today (had some partial work done before though).

Wasted a load of time writing Pascal Versions of structs that'll never be used :(

Anyway - my first functioning app looks like this...

Image

Yep, it's just Whisper-Bench with less details (running on CUDA)...

An obvious question people will ask is WHY Pascal? Well, the answer is that Delphi and Lazarus (but Laz version much later) are great at creating cross-platform GUI-based apps. This will run on Win, Mac, Linux (Delphi Enterprise + FMXLinux req), Android and iOS. Lazarus will even allow Raspberry Pi.

e.g. If I did a little work on the Benchmark then it would have charts and show multiple models on many platforms

Repo is here if anyone wants to look - it's extremely Alpha + Basic ATM

@peardox peardox changed the title Whisper.cpp Delphi Bindings Start of Whisper.cpp Delphi Bindings Apr 9, 2025
@peardox
Copy link
Author

peardox commented Apr 9, 2025

Image
Mac Mini M4 (Basic 256Gb version)

Hmm - Scaleway gave me a voucher for a Mac Mini M2 Pro (lowest version) today. Have to try that before voucher expires for comparison...

Be nice to do after I have some graphs + more models to test

@peardox
Copy link
Author

peardox commented Apr 11, 2025

Image
Linux Ubuntu 24 LTS

This is via WSL on Windows so using my main GPU (4070 Laptop)
Gee - the Encode is a helluva lot faster (will need to double-check some stuff, expecting same or slower)... Odd, second run (pressing button again) has a lot worse encode?

I've got a 10 year old Linux Media server - have to try that as well (no working GPU there though)

@basicbh
Copy link

basicbh commented Apr 30, 2025

加油 my bro!

@peardox
Copy link
Author

peardox commented Apr 30, 2025

Some new comparison images

Too big to go here...

@peardox
Copy link
Author

peardox commented May 2, 2025

And just got Pi5 8Gb working...

Only CPU as Vulkan kills it though :(

Image

Alpha Lazarus Version

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants