qaihm-bot commited on
Commit
5e7833d
·
verified ·
1 Parent(s): bd82ea3

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

BiseNet_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:31920ca598700a38667185f5cc4ce95455b219d552bdae0baaf56ad9b5fb0355
3
- size 48027668
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0efab004351a69cc3103415fc6d1cf2fccfce586a9b3cfadec7623c6ec2b1488
3
+ size 48027764
BiseNet_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:23cc5f75afc7b75afc010c2072d29196d214787782c62e5992cafbf5650c2a62
3
  size 44672543
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d88ba570a9501d8af8602dfa15a47af9f327ebcbb8b4193a3c30ec5d489d3950
3
  size 44672543
BiseNet_w8a8.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e9f1a1c6bd38d8361cc6a3e151d7f1fc3ade84a6dc6902a3bf7014b89d74942
3
- size 12443796
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fc5fcd94fbaa12d56ad5fdbda5fc75e263782ddf7fd8b27c00d5bf9d83f7575
3
+ size 12443892
BiseNet_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:06b832bdd1be1fb663edba02faf2d584b920a49b175152712e1a2162642e5b93
3
  size 20202978
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af7a9167af5fcc162bf1c69e0df2913d54a41498bbddf39fa3205f7fb982af82
3
  size 20202978
README.md CHANGED
@@ -37,71 +37,74 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | BiseNet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 133.493 ms | 31 - 66 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
41
- | BiseNet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 119.946 ms | 3 - 58 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
42
- | BiseNet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 55.36 ms | 32 - 77 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
43
- | BiseNet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 62.235 ms | 8 - 59 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
44
- | BiseNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 46.415 ms | 32 - 82 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
45
- | BiseNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 38.282 ms | 8 - 27 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
46
- | BiseNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 33.47 ms | 71 - 83 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
47
- | BiseNet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 56.382 ms | 32 - 67 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
48
- | BiseNet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 45.124 ms | 2 - 78 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
49
- | BiseNet | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 133.493 ms | 31 - 66 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
50
- | BiseNet | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 119.946 ms | 3 - 58 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
51
- | BiseNet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 46.678 ms | 32 - 83 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
52
- | BiseNet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 37.636 ms | 8 - 33 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
53
- | BiseNet | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 60.817 ms | 32 - 69 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
54
- | BiseNet | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 49.014 ms | 0 - 72 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
55
- | BiseNet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 46.615 ms | 2 - 27 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
56
- | BiseNet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 38.088 ms | 8 - 30 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
57
- | BiseNet | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 56.382 ms | 32 - 67 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
58
- | BiseNet | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 45.124 ms | 2 - 78 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
59
- | BiseNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 31.956 ms | 31 - 75 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
60
- | BiseNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 27.017 ms | 8 - 69 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
61
- | BiseNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 26.946 ms | 73 - 126 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
62
- | BiseNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 26.061 ms | 30 - 70 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
63
- | BiseNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 19.817 ms | 8 - 74 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
64
- | BiseNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 19.37 ms | 65 - 121 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
65
- | BiseNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 23.416 ms | 31 - 72 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
66
- | BiseNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 16.182 ms | 8 - 95 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
67
- | BiseNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 15.437 ms | 73 - 135 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
68
- | BiseNet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 36.526 ms | 8 - 8 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
69
- | BiseNet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 31.602 ms | 66 - 66 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
70
- | BiseNet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 24.419 ms | 7 - 43 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
71
- | BiseNet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 21.392 ms | 2 - 53 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
72
- | BiseNet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 16.498 ms | 8 - 73 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
73
- | BiseNet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 17.844 ms | 2 - 73 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
74
- | BiseNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 14.662 ms | 8 - 19 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
75
- | BiseNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 10.447 ms | 2 - 23 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
76
- | BiseNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 10.403 ms | 8 - 53 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
77
- | BiseNet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 14.998 ms | 8 - 45 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
78
- | BiseNet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 10.955 ms | 2 - 53 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
79
- | BiseNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 54.26 ms | 8 - 67 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
80
- | BiseNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 56.766 ms | 2 - 84 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
81
- | BiseNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 221.924 ms | 208 - 222 MB | CPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
82
- | BiseNet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 292.511 ms | 8 - 11 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
83
- | BiseNet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 197.24 ms | 195 - 215 MB | CPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
84
- | BiseNet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 24.419 ms | 7 - 43 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
85
- | BiseNet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 21.392 ms | 2 - 53 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
86
- | BiseNet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 14.777 ms | 7 - 19 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
87
- | BiseNet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 10.407 ms | 2 - 22 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
88
- | BiseNet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 17.442 ms | 8 - 50 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
89
- | BiseNet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 13.598 ms | 2 - 57 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
90
- | BiseNet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 14.997 ms | 8 - 19 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
91
- | BiseNet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 10.411 ms | 2 - 21 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
92
- | BiseNet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 14.998 ms | 8 - 45 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
93
- | BiseNet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 10.955 ms | 2 - 53 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
94
- | BiseNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 10.802 ms | 6 - 65 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
95
- | BiseNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 7.447 ms | 2 - 78 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
96
- | BiseNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 7.507 ms | 18 - 90 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
97
- | BiseNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 8.278 ms | 7 - 49 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
98
- | BiseNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 5.777 ms | 2 - 62 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
99
- | BiseNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 5.728 ms | 18 - 75 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
100
- | BiseNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 7.264 ms | 6 - 47 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
101
- | BiseNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 4.935 ms | 2 - 63 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
102
- | BiseNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 4.527 ms | 18 - 84 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
103
- | BiseNet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 10.929 ms | 0 - 0 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
104
- | BiseNet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.676 ms | 19 - 19 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
 
 
 
105
 
106
 
107
 
@@ -115,9 +118,9 @@ pip install qai-hub-models
115
  ```
116
 
117
 
118
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
119
 
120
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
121
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
122
 
123
  With this API token, you can configure your client to run models on the cloud
@@ -125,7 +128,7 @@ hosted devices.
125
  ```bash
126
  qai-hub configure --api_token API_TOKEN
127
  ```
128
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
129
 
130
 
131
 
@@ -236,7 +239,7 @@ With the output of the model, you can compute like PSNR, relative errors or
236
  spot check the output with expected output.
237
 
238
  **Note**: This on-device profiling and inference requires access to Qualcomm®
239
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
240
 
241
 
242
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | BiseNet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 133.376 ms | 32 - 69 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
41
+ | BiseNet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 111.86 ms | 3 - 75 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
42
+ | BiseNet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 55.56 ms | 32 - 79 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
43
+ | BiseNet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 63.236 ms | 8 - 60 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
44
+ | BiseNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 46.549 ms | 32 - 49 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
45
+ | BiseNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 32.723 ms | 8 - 26 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
46
+ | BiseNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 33.304 ms | 63 - 122 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
47
+ | BiseNet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 56.389 ms | 32 - 69 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
48
+ | BiseNet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 41.608 ms | 2 - 73 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
49
+ | BiseNet | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 133.376 ms | 32 - 69 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
50
+ | BiseNet | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 111.86 ms | 3 - 75 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
51
+ | BiseNet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 46.029 ms | 20 - 38 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
52
+ | BiseNet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 32.78 ms | 8 - 28 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
53
+ | BiseNet | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 61.008 ms | 32 - 74 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
54
+ | BiseNet | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 47.183 ms | 6 - 56 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
55
+ | BiseNet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 46.075 ms | 20 - 38 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
56
+ | BiseNet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 33.258 ms | 8 - 31 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
57
+ | BiseNet | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 56.389 ms | 32 - 69 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
58
+ | BiseNet | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 41.608 ms | 2 - 73 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
59
+ | BiseNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 31.893 ms | 31 - 76 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
60
+ | BiseNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 24.512 ms | 8 - 66 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
61
+ | BiseNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 26.227 ms | 73 - 129 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
62
+ | BiseNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 26.62 ms | 30 - 73 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
63
+ | BiseNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 20.068 ms | 8 - 77 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
64
+ | BiseNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 19.324 ms | 65 - 121 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
65
+ | BiseNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 22.725 ms | 31 - 73 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.tflite) |
66
+ | BiseNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 17.424 ms | 8 - 79 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
67
+ | BiseNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 15.303 ms | 73 - 136 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
68
+ | BiseNet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 31.161 ms | 8 - 8 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.dlc) |
69
+ | BiseNet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 31.68 ms | 66 - 66 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet.onnx.zip) |
70
+ | BiseNet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 24.46 ms | 8 - 46 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
71
+ | BiseNet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 21.383 ms | 2 - 55 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
72
+ | BiseNet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 16.485 ms | 8 - 70 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
73
+ | BiseNet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 18.298 ms | 2 - 69 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
74
+ | BiseNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 15.023 ms | 8 - 19 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
75
+ | BiseNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 10.391 ms | 2 - 20 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
76
+ | BiseNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 10.428 ms | 8 - 55 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
77
+ | BiseNet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 14.981 ms | 8 - 46 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
78
+ | BiseNet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 11.001 ms | 2 - 53 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
79
+ | BiseNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 54.89 ms | 8 - 68 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
80
+ | BiseNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 55.786 ms | 2 - 87 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
81
+ | BiseNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 220.532 ms | 206 - 219 MB | CPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
82
+ | BiseNet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 287.541 ms | 8 - 11 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
83
+ | BiseNet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 194.766 ms | 198 - 224 MB | CPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
84
+ | BiseNet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 24.46 ms | 8 - 46 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
85
+ | BiseNet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 21.383 ms | 2 - 55 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
86
+ | BiseNet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 14.51 ms | 8 - 24 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
87
+ | BiseNet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 10.358 ms | 2 - 23 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
88
+ | BiseNet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 17.559 ms | 8 - 50 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
89
+ | BiseNet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 13.553 ms | 2 - 56 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
90
+ | BiseNet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 14.662 ms | 7 - 22 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
91
+ | BiseNet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 10.396 ms | 2 - 21 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
92
+ | BiseNet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 14.981 ms | 8 - 46 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
93
+ | BiseNet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 11.001 ms | 2 - 53 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
94
+ | BiseNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 10.798 ms | 6 - 64 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
95
+ | BiseNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 7.441 ms | 2 - 75 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
96
+ | BiseNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 7.523 ms | 18 - 88 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
97
+ | BiseNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 8.284 ms | 7 - 50 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
98
+ | BiseNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 5.769 ms | 2 - 61 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
99
+ | BiseNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 5.705 ms | 16 - 74 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
100
+ | BiseNet | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 20.504 ms | 0 - 53 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
101
+ | BiseNet | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 16.35 ms | 2 - 72 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
102
+ | BiseNet | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 213.382 ms | 212 - 227 MB | CPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
103
+ | BiseNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 7.193 ms | 6 - 48 MB | NPU | [BiseNet.tflite](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.tflite) |
104
+ | BiseNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 4.903 ms | 2 - 65 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
105
+ | BiseNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 4.539 ms | 18 - 85 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
106
+ | BiseNet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 10.918 ms | 11 - 11 MB | NPU | [BiseNet.dlc](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.dlc) |
107
+ | BiseNet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.927 ms | 19 - 19 MB | NPU | [BiseNet.onnx.zip](https://huggingface.co/qualcomm/BiseNet/blob/main/BiseNet_w8a8.onnx.zip) |
108
 
109
 
110
 
 
118
  ```
119
 
120
 
121
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
122
 
123
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
124
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
125
 
126
  With this API token, you can configure your client to run models on the cloud
 
128
  ```bash
129
  qai-hub configure --api_token API_TOKEN
130
  ```
131
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
132
 
133
 
134
 
 
239
  spot check the output with expected output.
240
 
241
  **Note**: This on-device profiling and inference requires access to Qualcomm®
242
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
243
 
244
 
245