Skip to content

Releases: roboflow/inference

v0.56.0

19 Sep 20:06
8f5716f

Choose a tag to compare

What's Changed

Full Changelog: v0.55.2...v0.56.0

v0.55.2

17 Sep 20:09
925dca9

Choose a tag to compare

What's Changed

  • fix DD and Serverless auth for legacy endpoints by @hansent in #1566

Full Changelog: v0.55.1...v0.55.2

v0.55.1

17 Sep 14:24
e601875

Choose a tag to compare

What's Changed

  • ⚡️ Speed up function handle_describe_workflows_blocks_request by 84% in PR #1559 (auth-all-serverless-requests) by @codeflash-ai[bot] in #1563
  • Move receiving from VideoTransformTrack.recv to independent incoming frames draining loop by @grzegorz-roboflow in #1560
  • API key for all requests on servless by @hansent in #1559
  • increase timeout INTEGRATION TESTS - Inference Server CPU x86 by @hansent in #1564

Full Changelog: v0.55.0...v0.55.1

0.55.0

13 Sep 01:47
c535b88

Choose a tag to compare

What's Changed

Full Changelog: v0.54.2...v0.55.0

v0.54.2

05 Sep 12:51
004f1f8

Choose a tag to compare

🔧 Fixed

🧑‍🏭 Maintenance

🥼 inference-experimental changes

Full Changelog: v0.54.1...v0.54.2

v0.54.1

29 Aug 18:15
e8049bf

Choose a tag to compare

🔧 Fixed

Full Changelog: v0.54.0...v0.54.1

v0.54.0

29 Aug 15:06
c76f59e

Choose a tag to compare

💪 Added

inference server with non-blocking handlers

We redesigned request handling to eliminate event-loop blocking in FastAPI. The server now processes requests non-blocking, enabling higher concurrency and improved throughput while keeping latency about the same.

  • 🛠️ Removed event-loop bottlenecks in the request pipeline
  • 📈 Higher throughput under load
  • ⏱️ Comparable latency

ℹ️ No action required.

💻 Discover server logs with ease

A fresh, at-a-glance dashboard for your Roboflow Inference server—status, metrics, and live logs in one place. All thanks to @digaobarbosa

  • 🟢 Health & Status: Server health badge, version, server ID, uptime, and memory usage.
  • 📦 Loaded Models: Clear empty state when no models are active.
  • 📈 API Requests: Totals and success rate to monitor reliability.
  • 🪵 Live Logs: Real-time tailing with level filter, text search, auto-scroll, and “latest” timestamp.
  • 🔄 Manual Refresh: Update metrics on demand (Refresh Data).

Where to find it: open the new Inference Dashboard from inference landing page

Tip

To get access to dashboard, start your inference server with the following environmental variables ENABLE_IN_MEMORY_LOGS=true and ENABLE_DASHBOARD=True

image

🔧 Fixed

Full Changelog: v0.53.0...v0.54.0

v0.53.0

26 Aug 15:18
a8ba225

Choose a tag to compare

💪 Added

🌀 Execution Engine v1.6.0

No more wrestling with Batch[T] vs. scalar inputs! The engine now auto-magically wraps scalars into batches when needed, so those annoying compilation errors are history.

  • 🪄 Auto Batch Casting: scalars become batches on the fly.

  • 📦 Smarter outputs: batches can expand or collapse consistently.

  • 👉 Existing workflows keep running just fine. New workflows get all the power-ups. Only some new blocks will need to add additional manifest method to make use of new features

Please review our change log 🥼 which outlines all introduced changes.

🏷️ QR code generation in Workflows

Ever struggled to generate QR code? We have you covered now with Roboflow Workflows ✨ thanks to @Grantimus9. Visit 📖 docs to discover new feature.

image

🎨 Add icons to your visualisations

Bored with textual labels in your Computer Vision demos? From now on, thanks to @yeldarby you can boost your visualisations with icons. Visit 📖 docs to learn more.

image

⚙️ Maintanence

🔧 Fixed

  • Add env variable to perform atomic cache writes by @sberan in #1503
  • Support max detections for OWLv2 models by @yeldarby in #1508
  • Add model-instance level thread lock on accessing ONNX session to avoid GPU execution concurrency issues by @PawelPeczek-Roboflow in #1510

🏅 New Contributors

Full Changelog: v0.52.1...v0.53.0

v0.52.1

15 Aug 18:54
27c1f2c

Choose a tag to compare

Inference

New Contributors

Full Changelog: v0.52.0...v0.52.1

v0.52.0

11 Aug 19:37
788b5ac

Choose a tag to compare

Inference:

Inference experimental:

New Contributors

Full Changelog: v0.51.10...v0.52.0