Skip to content

discussions Search Results · repo:pytorch/executorch language:Python

65 results
 (105 ms)

65 results

inpytorch/executorch (press backspace or delete to remove)

🚀 The feature, motivation and pitch Currently, ET users interact directly with the ET runtime, which in turn interacts with backends determined by the AoT process. Backend-specific configurations can ...

I read the code of get_8a8w_qnn_ptq_config, I found the minimum values of weight quantization is a one more than activation and bias quantization, please refer to: https://github.com/pytorch/executorch/blob/main/backends/qualcomm/quantizer/qconfig.py#L88 ...

🚀 The feature, motivation and pitch Hi PyTorch team, I m interested in using the ExecuTorch Vulkan backend on Linux. While the documentation mentions the Vulkan delegate being cross-platform, the current ...

My team aims to develop a heterogeneous inference framework using ExecuTorch, but we are currently grappling with challenges in heterogeneous quantization. Consider this scenario: For a single model, ...

After executing a quantized model, the operator name recorded by etdump is Fully Connected (NC, QD8, F32, QB4W) GEMM #1 . Could you please tell me which kernel this corresponds to and how to find it?

🚀 The feature, motivation and pitch foreword and motivation This is a foreword on mutable states and the forward pass. Compared to history, people are now writing models with more types of state which ...
  • awgrposted
    on Aug 15, 2024
  • 5

RFC: Local Benchmarking and Evaluation Tooling Note: This initial draft is being actively iterated on. An updated draft will be posted within the next few days. The purpose of this RFC is to solicit ...

Benchmark Infra Stability Assessment with private AWS devices TL;DR Analysis reveals that private AWS device can provide acceptable stability across all tested platforms (Android, iOS), delegates (QNN, ...

Introduction The purpose of this RFC is to propose shared test suites and stress test infrastructure that can run against all ExecuTorch backends. These backends should be able to integrate with this ...

Does it make sense for executorch to have a mobile cuda backend? There are many edge devices in the Jetson lineup from nvidia that have a cuda gpu, but can benefit from not wanting to link an enormous ...