autotrust
/

JEV-9B

Model card Files Files and versions

JEV-9B / reports /vllm_openai_9b.json

cloudyu's picture

autotrust/JEV: model weights, System 1 adapter + decision head, vLLM adapter, calibration and evaluation reports

c3ee780 2 days ago

History Blame Contribute Delete

227 Bytes

	{
	"n": 2000,
	"concurrency": 64,
	"req_per_s": 150.14946557251415,
	"p50_ms": 411.9391441345215,
	"p90_ms": 559.4574689865112,
	"vs_pytorch_max_abs_dp": 0.0038683414459228516,
	"vs_pytorch_mean_abs_dp": 0.0008296253508888185
	}