Capability
Local Inference Via Ollama Cli And Rest Api
20 artifacts provide this capability.
Want a personalized recommendation?
Find the best match →Top Matches
1
Llama 3.2 90B VisionModel46/100
via “single-node inference via ollama integration”
Meta's largest open multimodal model at 90B parameters.
Unique: Provides Ollama integration for simplified single-node inference with automatic model management, reducing deployment friction compared to raw PyTorch but still requiring multi-GPU hardware for 90B model
vs others: Simpler deployment than custom PyTorch inference with automatic quantization and API exposure, though still requires significant local compute compared to cloud API alternatives