#onnx #metal #tensorflow #neural-network

tract-metal

Tiny, no-nonsense, self contained, TensorFlow and ONNX inference

8 releases

Uses new Rust 2024

0.22.0 Aug 26, 2025
0.21.13 May 15, 2025
0.21.12 Apr 10, 2025
0.21.11 Mar 19, 2025
0.21.7 Sep 23, 2024

#2103 in Machine learning

Download history 142/week @ 2025-08-26 114/week @ 2025-09-02 34/week @ 2025-09-09 61/week @ 2025-09-16 24/week @ 2025-09-23 60/week @ 2025-09-30 20/week @ 2025-10-07 22/week @ 2025-10-14 32/week @ 2025-10-21 5/week @ 2025-10-28 48/week @ 2025-11-11 4/week @ 2025-11-18 17/week @ 2025-12-02 214/week @ 2025-12-09

248 downloads per month
Used in 4 crates (2 directly)

MIT/Apache

1.5MB
42K SLoC

tract-metal

Updating Metal Flash Attention library

git clone https://github.com/philipturner/metal-flash-attention.git
cd metal-flash-attention

# for iOS
swift build.swift --platform iOS --xcode-path /Applications/Xcode.app
cp build/lib/libMetalFlashAttention.metallib path/to/tract/metal/src/kernels/libMetalFlashAttention-ios.metallib

# for MacOS
swift build.swift --platform macOS --xcode-path /Applications/Xcode.app
cp build/lib/libMetalFlashAttention.metallib path/to/tract/metal/src/kernels/libMetalFlashAttention-macos.metallib

Dependencies

~21–35MB
~504K SLoC