Search results

How to calculate perplexity (PPL) from vLLM served models like Qwen2.5-7B-Instruct

Status: Open.

#18 In asahi417/lmppl;

· randydl opened on Jun 26, 2025

Non-deterministic result for Example on the main readme

Status: Open.

#16 In asahi417/lmppl;

· qiisziilbash opened on Feb 26, 2025

Runtime Error

Status: Open.

#15 In asahi417/lmppl;

· qiisziilbash opened on Feb 24, 2025

Can the LLAMA model be used for this project, please

Status: Open.

#8 In asahi417/lmppl;

· KangkangStu opened on Oct 31, 2023

ImportError while trying to use device_map = "auto" parameter.

Status: Open.

#7 In asahi417/lmppl;

· dogukantai opened on Jul 1, 2023

Dataset too large

Status: Open.

#6 In asahi417/lmppl;

· NHendrickson9616 opened on Jun 27, 2023