software-mansion/react-native-executorch-qwen-2.5

qwen-2.5

This repository hosts the qwen-2.5 models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Variants

Path	Backend	Precision	Context length
0_5b/mlx/qwen_2_5_0_5b_mlx_int4.pte	mlx	int4	16,384
0_5b/xnnpack/qwen_2_5_0_5b_xnnpack_8da4w.pte	xnnpack	8da4w	16,384
1_5b/mlx/qwen_2_5_1_5b_mlx_int4.pte	mlx	int4	16,384
1_5b/xnnpack/qwen_2_5_1_5b_xnnpack_8da4w.pte	xnnpack	8da4w	16,384
3b/mlx/qwen_2_5_3b_mlx_int4.pte	mlx	int4	8,192
3b/xnnpack/qwen_2_5_3b_xnnpack_8da4w.pte	xnnpack	8da4w	8,192

Repository structure

0_5b/mlx/config.json                          1.3 KiB
0_5b/mlx/qwen_2_5_0_5b_mlx_int4.pte           510 MiB
0_5b/xnnpack/config.json                      1.3 KiB
0_5b/xnnpack/qwen_2_5_0_5b_xnnpack_8da4w.pte  412 MiB
1_5b/mlx/config.json                          1.3 KiB
1_5b/mlx/qwen_2_5_1_5b_mlx_int4.pte           1.2 GiB
1_5b/xnnpack/config.json                      1.3 KiB
1_5b/xnnpack/qwen_2_5_1_5b_xnnpack_8da4w.pte  1.1 GiB
3b/mlx/config.json                            1.3 KiB
3b/mlx/qwen_2_5_3b_mlx_int4.pte               2.1 GiB
3b/xnnpack/config.json                        1.3 KiB
3b/xnnpack/qwen_2_5_3b_xnnpack_8da4w.pte      2.0 GiB
config.json                                   30 B
tokenizer.json                                6.7 MiB
tokenizer_config.json                         7.1 KiB

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.