PHASE 03PROTON SDK
In development

A practical developer path from model file to device evidence.

The planned Proton SDK connects GGUF inspection, llama.cpp and GGML integration, runtime control, firmware, kernels, profiling, and numerical validation.

PUBLIC STATUS BOUNDARY

Planned developer artifacts are not yet downloadable

CODE-NATIVE SYSTEM VIEW
EDITABLE / RESPONSIVE
01GGUF modelMODEL
02llama.cpp / GGMLHOST
03Proton backendHOST
04Proton runtimeHOST
05Firmware and kernelsDEVICE
06Proton LPU or ProtonSimDEVICE
FUTURE SDK FRONTENDIREE
01MODEL INSPECTION

Understand the model before selecting execution paths.

The SDK direction includes GGUF metadata, tensor layout, operator mix, shape, and quantization inspection so software and hardware decisions share the same workload contract.

02LLAMA.CPP + GGML

Meet developers where local models already run.

The initial integration path is a Proton GGML backend that maps supported operations to the runtime while preserving a reference execution path for comparison.

03RUNTIME + COMMAND ABI

Make command submission explicit and inspectable.

Runtime APIs, queues, buffers, synchronization, and device commands are intended to expose the boundary between host orchestration and accelerator execution.

04FIRMWARE + KERNELS

Target-specific code remains tied to deterministic checks.

Candidate kernels include quantized dot products, unpacking, activation quantization, normalization, positional operations, and matrix or vector tiles.

Generated or hand-written code is not accepted without compilation and independent numerical checks.

05PROFILING + VALIDATION

A device run is incomplete without comparison evidence.

Profiling and numerical comparison are intended to connect timing, memory movement, operator coverage, and output differences back to the model and architecture decision.

06FUTURE FRONTEND

IREE remains a later compiler integration path.

The first path prioritizes GGUF and llama.cpp. IREE is retained as a future frontend direction rather than presented as current integration.

CONTINUE THE SYSTEM

Explore system architecture

Continue