Search results

Template model fails to parse top level JSON Array in Response

Status: Open.

#1090 In ai-dynamo/aiperf;

· Lokiiiiii opened on Jul 2, 2026

[Contribution] Feature: Persistent system prompt for multi-turn datasets

Status: Open.

#1062 In ai-dynamo/aiperf;

· hatemfaheem opened on Jun 23, 2026

request_content_type=multipart/form-data should be supported for ASR models like standlalone whisper

Status: Open.

Feature

#1059 In ai-dynamo/aiperf;

· Maze999 opened on Jun 17, 2026

--tokenizer-trust-remote-code cannot load DeepSeek-V3.2-Exp tokenizer (model_type=deepseek_v32) — no config fallback for an unregistered model_type without auto_map

Status: Open.

#1047 In ai-dynamo/aiperf;

· janbernloehr opened on Jun 10, 2026

credit pipeline: surface mid-run issuance-task exceptions instead of swallowing them (follow-up to #1039)

Status: Open.

#1041 In ai-dynamo/aiperf;

· ajcasagrande opened on Jun 6, 2026

Add support for agentic (multi-step, stateful, tool-calling) evals

Status: Open.

#1038 In ai-dynamo/aiperf;

· abatilo opened on Jun 5, 2026

Add swe_rebench_openhands public dataset loader for agentic multi-turn benchmarking

Status: Open.

#1019 In ai-dynamo/aiperf;

· Lokiiiiii opened on Jun 2, 2026

# Categorize MLflow metrics with system/ prefix for HTTP trace and internal metrics

Status: Open.

#1017 In ai-dynamo/aiperf;

· Lokiiiiii opened on Jun 2, 2026

extract_chat_response_data raises ValueError on streaming chunks with object: null (instead of treating as end-of-stream)

Status: Open.

#1010 In ai-dynamo/aiperf;

· janbernloehr opened on May 29, 2026

[Roadmap] AIPerf June + Q3 2026

roadmapRoadmap and planning issuesRoadmap and planning issues

Status: Open.

#1009 In ai-dynamo/aiperf;

· BenHamm opened on May 29, 2026

Synthetic-only flags silently ignored with --public-dataset

Status: Open.

#996 In ai-dynamo/aiperf;

· Lokiiiiii opened on May 26, 2026

Support AA-AgentPerf Benchmark Execution

Status: Open.

#987 In ai-dynamo/aiperf;

· Lokiiiiii opened on May 22, 2026