Vice President of Engineering
Nesa | 2023 – Present
Architected a distributed inference framework for 120,000 models, handling up to 2M requests per day on heterogeneous hardware.
Designed and implemented Nesa’s layer 1 blockchain for decentralized AI compute.
Built telemetry pipeline using NATS.io and Prometheus to monitor nodes.
Led secure containerization for user-submitted models.
Contributed to equivariant encryption (EE) achieving zero-latency private inference.
Developed reinforcement learning system for dynamic model assignment.
Contributed to open-source: xFusers and nats.py stability improvements.