ToolSlack: Exploiting Tool Execution Windows for Efficient LLM Agent Serving
-
Updated
Oct 2, 2026 - Python
#
agent-serving
Here are 2 public repositories matching this topic...
LLM agent interruptions and mid-execution revisions through versioned execution: revoke old authority, bound obsolete work, and coordinate the successor's takeover. Research implementation in vLLM.
ai-agents kv-cache inference-serving llm-serving vllm agent-serving agent-interruption versioned-execution
-
Updated
Oct 19, 2026 - Python
Add this topic to your repo
To associate your repository with the agent-serving topic, visit your repo's landing page and select "manage topics."