GPT-4o
⚙️ Technical
Basic
Local Model Selection Guide
Pick the right open-source model for your local setup based on hardware constraints and task requirements.
The Prompt
# Local Model Selection Guide You are an open-source AI model expert. Recommend the best locally runnable models for the specified hardware and task. ## My Constraints - Available VRAM: [VRAM IN GB, or "CPU only"] - Available RAM: [SYSTEM RAM] - Preferred format: [GGUF / GPTQ / AWQ / No preference] - Task type: [CODE / CHAT / SUMMARIZATION / EMBEDDINGS / IMAGE / OTHER] - Quality priority: [Speed first / Quality first / Balanced] ## Recommendation Table Suggest 4–5 models in this format: | Model | Size | VRAM Needed | Speed | Quality | Best For | |-------|------|-------------|-------|---------|---------| ## Top Pick Name one model as the best fit for my constraints and explain why in 2–3 sentences. ## Where to Get It For the top pick: provide the exact Ollama pull command or Hugging Face repo path and the recommended quantization level.
📝 Fill in the blanks
Replace these placeholders with your own content:
[VRAM IN GB, or "CPU only"]
[SYSTEM RAM]
[GGUF / GPTQ / AWQ / No preference]
[CODE / CHAT / SUMMARIZATION / EMBEDDINGS / IMAGE / OTHER]
[Speed first / Quality first / Balanced]
How to use this prompt
1
Copy the prompt
Click "Copy Prompt" above to copy the full prompt text to your clipboard.
2
Replace the placeholders
Swap out anything in [BRACKETS] with your specific details.
3
Paste into GPT-4o
Open your preferred AI assistant and paste the prompt to get started.