cyankiwi
/

MiroThinker-v1.0-72B-AWQ-4bit

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Resources

View closed (1)

I hope an MLX-8bit format can be released.

#3 opened about 14 hours ago by

Not able to run this model in AWQ 4bit, getting gibberish output on 16k+ context

#2 opened about 1 month ago by