Pinned Loading

1. EntropyCache EntropyCache Public

   EntropyCache: Decoded Token Entropy Guided KV Caching for Diffusion Language Models

   2

2. TaSQ TaSQ Public

   Official code for paper "Tailoring the Quantization Space for 1-Bit KV Cache Compression"

   Python 7

3. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 131k 24.4k

4. krotoDC krotoDC Public

   Protobuf Kotlin Dataclass, Converter & Custom Kotlin Coroutine gRPC Generator

   Kotlin 109 12