The fact
The 30B-A3B-NVFP4 version targets low-latency applications.
The model is available on Hugging Face for developers.
Click the link to read an article on the topic:
The 30B-A3B-NVFP4 version targets low-latency applications.
The model is available on Hugging Face for developers.