Built a KV cache inference engine for GPT-2 in CUDA while learning how LLMs actually run — feedback welcome + how do I break into inference engineering?
Open Internet by MindsNet
Built a KV cache inference engine for GPT-2 in CUDA while learning how LLMs actually run — feedback welcome + how do I break into inference engineering?