Skip to content

Add Llama ONNX GenAI validated path to text-to-text Android LP - #3768

Open
BelachewRachel wants to merge 1 commit into
ArmDeveloperEcosystem:mainfrom
BelachewRachel:ai-portal-mobile-text-to-text-updates
Open

BelachewRachel wants to merge 1 commit into
ArmDeveloperEcosystem:mainfrom
BelachewRachel:ai-portal-mobile-text-to-text-updates

Conversation

@BelachewRachel

@BelachewRachel BelachewRachel commented Sep 17, 2026

Copy link
Copy Markdown

Adds the validated Llama 3.2 ONNX Runtime GenAI path to the text-to-text Android Learning Path.

Updates:

  • Adds Llama 3.2 ONNX Runtime GenAI to the validated model table.
  • Updates the runtime comparison page so learners can use either TinyLlama or Llama 3.2 with the ONNX Runtime GenAI validated example.

Before submitting a pull request for a new Learning Path, please review Create a Learning Path

  • I have reviewed Create a Learning Path

Please do not include any confidential information in your contribution. This includes confidential microarchitecture details and unannounced product information.

  • I have checked my contribution for confidential information

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the Creative Commons Attribution 4.0 International License.

@matt-cossins

Copy link
Copy Markdown
Collaborator

@pareenaverma - I'll pick-up review of this

@matt-cossins matt-cossins left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@BelachewRachel - requires a small change to improve the instructions for running this example.

Application PR is approved: https://github.com/arm-education/ai-portal-android-app-text-to-text.

### Prepare the ONNX Runtime GenAI path

The TinyLlama example uses `com.microsoft.onnxruntime:onnxruntime-android:1.27.0` and the official ONNX Runtime GenAI Android AAR. First, complete the [ONNX Runtime GenAI Android Learning Path](https://learn.arm.com/learning-paths/mobile-graphics-and-gaming/build-android-chat-app-using-onnxruntime/) to build `onnxruntime-genai-release.aar`.
The ONNX Runtime GenAI examples use `com.microsoft.onnxruntime:onnxruntime-android:1.27.0` and the official ONNX Runtime GenAI Android AAR. First, complete the [ONNX Runtime GenAI Android Learning Path](https://learn.arm.com/learning-paths/mobile-graphics-and-gaming/build-android-chat-app-using-onnxruntime/) to build `onnxruntime-genai-release.aar`.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This linked learning path only has instructions for Windows Powershell, and it is not immediately clear what you need to do.

It looks like not too many commands to get the AAR, so please provide the instructions, for both Mac/Linux and Windows, directly in this LP.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants