Hi, I am trying to use MediaPipe to construct on-device LLM driven agents workflow for academic research. I wonder is it possible to use QNN TFLite Delegate to run LLM like gemma by Java API? Is it possible to delegate a “calculator” node to NPU within a MediaPipe Graph?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| TFLITE to mediapipe | 1 | 174 | June 26, 2024 | |
| Neural network fallback to CPU using NNAPI on Android | 12 | 4222 | July 12, 2022 | |
| Issue with GPU Delegate (Stuck on 2.3.0) | 4 | 2616 | April 20, 2022 | |
| Movenet GPU delegate error | 1 | 1056 | December 1, 2022 | |
| Integrating new third party delegates into tflite | 4 | 1378 | April 4, 2022 |