Self-Owned AI & Build Cluster (kk.ai)
Founder & Systems Architect | kk.ai
Designed and built a self-owned small-scale AI and compilation infrastructure to eliminate managed-cloud lock-in, data egress costs, and opaque token billing.
Distributed Build Acceleration
Architected a multi-node build cluster featuring Slurm workload scheduler, distributed sccache compilation with multi-level Redis caching, and per-node cgroup memory guards for Rust, C++, and Go projects.
Zero-Trust Credential Vault (kepr)
Designed and open-sourced kepr, a per-user credential vault in Rust utilizing AES-256-GCM encryption, Argon2id master-key derivation, RAM-sealed memfd secret delivery (no plaintext in /proc/environ), and hash-chained audit trails.
Local LLM Routing & Fleet Management
Built local LLM routing tiers and an OpenAI-compatible gateway so workstation and cluster resolve models through self-owned hardware. Maintained cross-node parity via deterministic dev-setup and drift detection tooling.
0 likes · 1 view · Oct 31, 2026
Multi-node AI & build cluster with Slurm, distributed sccache caching, and Rust kepr vault.
Timeline
Jul 1, 2026 - Oct 31, 2026