RedHatAI
/

quantization

Model card Files Files and versions

Activation

Quantization kernels from vLLM.

Copyright 2023-2024, the vLLM team.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including RedHatAI/quantization

vLLM Kernels

Collection of kernels from vLLM built using https://github.com/huggingface/kernel-builder • 2 items • Updated Nov 10 • 1