Self-Owned AI & Build Cluster (kk.ai) by Kamal PandeySelf-Owned AI & Build Cluster (kk.ai) by Kamal Pandey

Self-Owned AI & Build Cluster (kk.ai)

Portfolio project
Kamal Pandey

Self-Owned AI & Build Cluster (kk.ai)

Founder & Systems Architect | kk.ai
Designed and built a self-owned small-scale AI and compilation infrastructure to eliminate managed-cloud lock-in, data egress costs, and opaque token billing.

Distributed Build Acceleration

Architected a multi-node build cluster featuring Slurm workload scheduler, distributed sccache compilation with multi-level Redis caching, and per-node cgroup memory guards for Rust, C++, and Go projects.

Zero-Trust Credential Vault (kepr)

Designed and open-sourced kepr, a per-user credential vault in Rust utilizing AES-256-GCM encryption, Argon2id master-key derivation, RAM-sealed memfd secret delivery (no plaintext in /proc/environ), and hash-chained audit trails.

Local LLM Routing & Fleet Management

Built local LLM routing tiers and an OpenAI-compatible gateway so workstation and cluster resolve models through self-owned hardware. Maintained cross-node parity via deterministic dev-setup and drift detection tooling.

0 likes · 1 view · Oct 31, 2026

Multi-node AI & build cluster with Slurm, distributed sccache caching, and Rust kepr vault.

Timeline

Jul 1, 2026 - Oct 31, 2026

Tags