22 Pull requests merged by 12 people

• [Executorch][llm] Enable local global attention in export_llama script

  #10836 merged May 14, 2025

• Change lowbit example to use 4-bit as default in example

  #10865 merged May 14, 2025

• [LlamaDemo] Replace some tokens

  #10863 merged May 14, 2025

• Update CI for HF Optimum models

  #10820 merged May 14, 2025

• Update documents for Express SDK update

  #10462 merged May 14, 2025

• Remove EXECUTORCH_SEPARATE_FLATCC_HOST_PROJECT

  #10860 merged May 13, 2025

• Use the install method for flatc

  #10859 merged May 13, 2025

• Allow graceful handling of cpuinfo init failure

  #10826 merged May 13, 2025

• Arm backend: Decompose sum in pass

  #10852 merged May 13, 2025

• Build flatcc for the host

  #10855 merged May 13, 2025

• Arm backend: Merge decompose/convert meandim pass

  #10844 merged May 13, 2025

• BUCK forward fix on NXP backend

  #10838 merged May 13, 2025

• Qualcomm AI Engine Direct - Flags for CI

  #9536 merged May 13, 2025

• [Executorch][llm] Enable leveraging ring kv cache via module swap

  #10835 merged May 13, 2025

• Add floatValue to ExecuTorch value

  #10823 merged May 13, 2025

• Update ownership for the build system

  #10837 merged May 13, 2025

• [Executorch][llm] Make custom update cache op operate on indices

  #10834 merged May 13, 2025

• Delete executorch_print_configuration_summary

  #10806 merged May 13, 2025

• Arm backend: Fix mypy linting in pre-push

  #10850 merged May 13, 2025

• [Executorch][llm] Add ring buffer based kv cache and mask calculation to MHA

  #10833 merged May 13, 2025

• Move dependent options to default preset

  #10805 merged May 13, 2025

• Arm backend: Refactor pass tests for TOSA V1.0

  #10843 merged May 13, 2025

13 Pull requests opened by 10 people

• Arm backend: Update NEGATE with TOSA 1.0 support

  #10845 opened May 13, 2025

• Arm backend: Add test for DeiT Tiny for TOSA BI

  #10846 opened May 13, 2025

• Arm backend: Reenable test_fuse_const_ops_tosa_BI

  #10847 opened May 13, 2025

• Arm backend: Add DecomposeLinalgVectorNorm pass + tests

  #10848 opened May 13, 2025

• Arm backend: Update operator support for TOSA-1.0+INT+u55

  #10849 opened May 13, 2025

• Arm backend: Refactor misc tests for TOSA V1.0

  #10851 opened May 13, 2025

• Add a pass to fuse mul.Scalar into dequant

  #10853 opened May 13, 2025

• [jit] Remove more reference to TorchScript

  #10856 opened May 13, 2025

• Add pass to convert kwargs to args + populate optional args.

  #10857 opened May 13, 2025

• Allow setting thread count from Java

  #10858 opened May 13, 2025

• Fix broken tests

  #10866 opened May 14, 2025

• Mostly sync BlasKernel.cpp with ATen ReducedPrecisionGemvFastPathKernel

  #10868 opened May 14, 2025

• Update llama runner README.md

  #10869 opened May 14, 2025

6 Issues closed by 3 people

• [CMake] optimized_kernels and quantized_kernel will depend on portable_kernels.

  #10677 closed May 14, 2025

• Beefing up CONTRIBUTING.md to lower the barrier of entry for external contributors

  #9582 closed May 13, 2025

• [ET-LLM] Use pytorch-labs/tokenizers in ET

  #8376 closed May 13, 2025

• Editable mode is error-ing out with flatc message

  #8784 closed May 13, 2025

• Add complex dtype support to op_sum_dim

  #10431 closed May 13, 2025

• Add complex dtype support to op_mul

  #10430 closed May 13, 2025

5 Issues opened by 3 people

• Running Qwen3 XNNPACK on Android fails while setting up pretokenizer

  #10867 opened May 14, 2025

• Make PR label checker non-mandatory

  #10864 opened May 13, 2025

• Automatically specify params and metadata for export LLM

  #10862 opened May 13, 2025

• Allow loading downstream HF repos

  #10861 opened May 13, 2025

• Add first class citizen support for bundling along strings, ints etc. as metadata

  #10854 opened May 13, 2025

27 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Recipe and Input class definitions with e2e export

  #10034 commented on May 14, 2025 • 22 new comments

• Support prequant qwen3

  #10839 commented on May 14, 2025 • 10 new comments

• NXP backend: Create NeutronAtenPassManager with initial BatchNorm fusing passes

  #10579 commented on May 14, 2025 • 7 new comments

• NXP backend: Enable initial unit tests workflow

  #10258 commented on May 14, 2025 • 4 new comments

• Migrate ExecuTorch's use of pt2e from torch.ao to torchao

  #10294 commented on May 14, 2025 • 3 new comments

• Qualcomm AI Engine Direct - Enable custom operator

  #8726 commented on May 14, 2025 • 2 new comments

• Arm backend: Allocate the scratch buffer runtime rather than in the pte

  #10714 commented on May 14, 2025 • 1 new comment

• Undefined symbol while compiling runtime for MediaTek

  #10389 commented on May 13, 2025 • 0 new comments

• Pass to replace Adaptive Avg. Pool with Aten Avg. Pool

  #10818 commented on May 13, 2025 • 0 new comments

• Example external model to be used by the ahead of time arm compiler

  #10810 commented on May 14, 2025 • 0 new comments

• Update MemoryPlanning Verifier to only assume model has user input if it has at least one tensor input

  #10617 commented on May 14, 2025 • 0 new comments

• Introducing NXP Neutron runtime

  #10563 commented on May 14, 2025 • 0 new comments

• Arm backend: Fix sigmoid int16 and int32 flakyness

  #10548 commented on May 13, 2025 • 0 new comments

• [ExecuTorch][#10447] Extend `PyBundledModule` with `extension.BundledModule`

  #10450 commented on May 13, 2025 • 0 new comments

• Arm backend: Add TOSA support for GroupNorm

  #10198 commented on May 14, 2025 • 0 new comments

• Add some basic xnnpack recipes

  #10035 commented on May 14, 2025 • 0 new comments

• Consolidate executor_runners

  #10819 commented on May 13, 2025 • 0 new comments

• [devtool] create stream_data_sink

  #8604 commented on May 13, 2025 • 0 new comments

• Adjust tolerance for quantized XNN conv1d tests

  #8093 commented on May 13, 2025 • 0 new comments

• [docs][ez] Fix doc build workflow

  #8079 commented on May 13, 2025 • 0 new comments

• Revert to use mean_out than mean_dim_out

  #8021 commented on May 13, 2025 • 0 new comments

• remove the exec_aten namespace

  #8018 commented on May 13, 2025 • 0 new comments

• Fix comment in memory_planning.py

  #8010 commented on May 13, 2025 • 0 new comments

• fix spec_prop_pass

  #7974 commented on May 13, 2025 • 0 new comments

• [pytorch hash update] update the pinned pytorch hash

  #4589 commented on May 14, 2025 • 0 new comments

• Building ExecuTorch on RPi5 with Clang 14.0.6 fails due to bfloat incompatibility

  #8924 commented on May 14, 2025 • 0 new comments

• Advice on how to run the training example in Android

  #10593 commented on May 13, 2025 • 0 new comments