Skip to content
#

phi-3-5

Star

Here are 6 public repositories matching this topic...

Language: All
Filter by language
All 6 Python 2 C# 1 Jupyter Notebook 1 TypeScript 1 Bicep 1

G-B-KEVIN-ARJUN / size-precision-slm-bench

Star 0

is it better to run a Tiny Model (2B-4B) at High Precision (FP16/INT8), or a Large Model (8B+) at Low Precision (INT4)?" This benchmark framework allows developers to scientifically choose the best model for resource-constrained environments (consumer GPUs, laptops, edge devices) by measuring the trade-off between Speed and Intelligence

inference pytorch slm quantization inference-optimization edge-ai huggingface nvidia-rtx llm generative-ai llama-3 phi-3-5 llm-benchmark
  • Updated Jan 17, 2026
  • Python

Improve this page

Add a description, image, and links to the phi-3-5 topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the phi-3-5 topic, visit your repo's landing page and select "manage topics."

Learn more