Products

Developers

Resources

Company

Products

Developers

Resources

Company

Products

Developers

Resources

Company

One SDK across all Mobilint NPUs.

One SDK across all Mobilint NPUs.

One SDK across all Mobilint NPUs.

Mobilint designs the NPU architecture, compiler, quantizer and runtime together.


SDK qb is the software stack for every Mobilint NPU. qb Compiler turns trained models into NPU executables, and qb Runtime runs them in your application through the Mobilint device driver.

Edge efficiency with data-center programmability.

Edge efficiency with data-center programmability.

Edge efficiency with data-center programmability.

Efficiency

Efficiency

High performance per watt within edge power limits.

Utilization

Utilization

More of the run spent computing, less spent waiting on data.

Programmability

Programmability

490+ validated models, from CNNs to LLMs and VLMs.

Scalability

Scalability

One core design, from a single core to multi-chip systems.

SDK qb Flowchart

SDK qb Flowchart

SDK qb Flowchart

Pre-defined modelTensorFlowPyTorchONNX···Mobilint Compiler SuiteDocker containerizedqb CompilerQuantizerCompilerMobilint NPU ExecutablesCompiled model (.mxq)User SpaceTarget ApplicationMain LogicRuntime Libraryqb RuntimeKernel SpaceMobilint Device DriverHardwareMobilint NPUIncluded in SDK qbCompile once, then run through qb Runtime

qb Compiler:
Your trained model, compiled for the NPU

qb Compiler:
Your trained model, compiled for the NPU

qb Compiler:
Your trained model, compiled for the NPU

qb Compiler converts trained models into MXQ, the format Mobilint NPUs run. One compiler covers ARIES and REGULUS alike.

Models built and validated on a GPU carry over as they are, from vision models to LLMs.

INPUT

Trained model

Trained model

PyTorch, ONNX, TensorFlow and more.

01

Parse

Parse

Converts your model into one common graph.

02

Quantize

Quantize

Sets precision layer by layer, using sample inputs.

03

Compile

Compile

Builds an MXQ file for the target NPU.

OUTPUT

MXQ

MXQ

Loads with qb Runtime on ARIES and REGULUS.

FRAMEWORKS

Bring models from the tools you already use

Bring models from the tools you already use

ONNX logo
PyTorch logo
Keras logo
TensorFlow logo
Hugging Face logo

99%+

99%+

99%+

Of FP16 accuracy retained with mixed-precision quantization, with no retraining.

490+

490+

490+

Validated model architectures, from CNNs to LLMs and VLMs.

Accuracy that holds up at low bit-width.

Accuracy that holds up at low bit-width.

Accuracy that holds up at low bit-width.

Accuracy against FP16

Accuracy against FP16

MODEL

MODEL

FP16

FP16

MOBILINT

MOBILINT

RETAINED

RETAINED

MobileNetV2

MobileNetV2

71.81

71.81

71.45

71.45

99.5%

99.5%

ResNet50

ResNet50

76.27

76.27

75.74

75.74

99.3%

99.3%

YOLOv11s

YOLOv11s

44.54

44.54

44.32

44.32

99.5%

99.5%

YOLOv12s

YOLOv12s

46.03

46.03

45.75

45.75

99.4%

99.4%

The first two rows are Top-1 accuracy; the YOLO rows are AP.

LLMs at about 3 bits per weight

LLMs at about 3 bits per weight

MODEL

MODEL

FP16

FP16

STANDARD 3-BIT (GPTQ+SMOOTHQUANT)

STANDARD 3-BIT (GPTQ+SMOOTHQUANT)

MOBILINT (3.25-BIT)

MOBILINT (3.25-BIT)

Llama-3.2-3B-Instruct

Llama-3.2-3B-Instruct

10.87

10.87

448.94

448.94

13.66

13.66

Llama-3.1-8B-Instruct

Llama-3.1-8B-Instruct

7.82

7.82

1,208.72

1,208.72

9.51

9.51

Qwen3-4B-Instruct

Qwen3-4B-Instruct

10.73

10.73

30.81

30.81

12.37

12.37

Qwen3-8B

Qwen3-8B

10.34

10.34

30.36

30.36

11.65

11.65

WikiText2 perplexity (PPL); lower is better.

Mobilint Model Zoo

Mobilint Model Zoo

Browse a growing list of latest pre-compiled models with pre- and post-processing included.

qb Runtime:
Maximized flexibility for model and core configuration.

qb Runtime:
Maximized flexibility for model and core configuration.

qb Runtime:
Maximized flexibility for model and core configuration.

qb Runtime loads compiled MXQ models and schedules them on the NPU cores. Split one request across cores for lower latency, or give each core its own request for higher throughput.

01

Bring your model

Compile TensorFlow, PyTorch or ONNX models to MXQ with qb Compiler.

02

Load and request model

Load the MXQ file and send inference requests.

03

Choose the acceleration cores

Create an NPU instance and pick which cores run the model.

04

Call from your app

Python and C++ APIs on Linux and Windows.

Python

C++

Linux

Windows

GCC

MSVC

Two execution modes

Two execution modes

Co-Working Inference
Model 1Core 1Core 2Output 1

Both cores work on one request together, for lower latency.

Batch-Working Inference
Model 1Core 1Output 1Core 2Output 2

Each core runs its own request in parallel, for higher throughput.

Latency priority

Latency priority

All cores work on one input. Use it for real-time, single-batch work.

Throughput priority

Throughput priority

Cores work on separate inputs. Use it for multi-channel video and batch workloads.

Developer Resources

Developer Resources

Everything you need to build with Mobilint NPUs, in one place.

Everything you need to build with Mobilint NPUs, in one place.