Exécution de notre outil de synthèse sur un nouvel article

Vérifiez l’article ci-dessous, puis lancez sa synthèse.


POSTER: TinyLLM: Evaluation and Optimization of Small Language Models for Agentic Tasks on Edge Devices

Mohd Ariful Haque (Clark Atlanta University), Fahad Rahman (United International University), Kishor Datta Gupta (Clark Atlanta University), Khalil A. Shujaee (Clark Atlanta University), Roy George (Clark Atlanta University)

ACM International Conference on Computing Frontiers (CF)
DOI: 10.1145/3801487.3805608 (Computer Science)
Licence : CC BY

Résumé : As autonomous AI agents increasingly rely on Large Language Models (LLMs) for decision making; the necessity for local, privacy preserving execution on edge devices has become paramount. This paper investigates the effectiveness of Small Language Models (SLMs) with equal or fewer than 4 billion parameters for agentic tasks, specifically function and API calling. Using the Berkeley Function Calling Leaderboard (BFCL), we provide a comprehensive evaluation of models including xLAM-2, Qwen3, and TinyLlama. We introduce a Direct Preference Optimization (DPO) pipeline that leverages AgentBank (ALFRED) trajectories to align SLMs toward expert level tool use behavior. Our experimental results demonstrate a clear performance hierarchy where models in the 1-3B range significantly outperform sub 1B variants, achieving up to 65.74% overall accuracy and 55.62% in multi turn scenarios. Furthermore, we validate deployment feasibility through 4-bit quantization and hardware simulation, showing that these models can operate within the 8GB VRAM constraints of an Nvidia Jetson Nano while maintaining a functional throughput of ∼ 2.6 tokens/sec.

Publié le 19 Mai. 2026