This endeavour is currently a one(+ one) man operation.

we are currently building an ARM NEON, hardware accelerated KV cache.

KV cache is live. Kernel and OS are still on paper.