List view

add unit tests for kvcache aware scorer

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

pd-scheduler

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#218 In llm-d/llm-d-inference-scheduler;

· nirrozenbaum opened on Jul 2, 2025

Clarify relation between inference-scheduler and GW API inference extension project

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

Task

#281 In llm-d/llm-d-inference-scheduler;

· elevran opened on Aug 10, 2025

Port code of routing sidecar to inference-scheduler repository

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#335 In llm-d/llm-d-inference-scheduler;

· elevran opened on Sep 9, 2025

Port precise kv-cache scorer code to inference-scheduler repo?

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#336 In llm-d/llm-d-inference-scheduler;

· elevran opened on Sep 9, 2025

Test scaling to support multiple EPPs

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#337 In llm-d/llm-d-inference-scheduler;

· elevran opened on Sep 9, 2025

Run IGW HA and scaling test on llm-d-inference-scheduler

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#338 In llm-d/llm-d-inference-scheduler;

· elevran opened on Sep 9, 2025

Support for multiple LoRA

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#339 In llm-d/llm-d-inference-scheduler;

· elevran opened on Sep 9, 2025

Support for Data Parallelism in serving

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#340 In llm-d/llm-d-inference-scheduler;

· elevran opened on Sep 9, 2025

Changes in filters/scorers to support chat completions

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#341 In llm-d/llm-d-inference-scheduler;

· elevran opened on Sep 9, 2025