01
Kiln
LLM Inference Engine
An LLM inference engine written in C++ with custom CUDA kernels for attention, RMSNorm and RoPE. It serves SmolLM2-135M at 219–231 tokens/s on a GTX 1660 Ti through an OpenAI-compatible API (one request at a time), with final logits within ~6×10⁻⁵ of Hugging Face on two checkpoints. In a CPU benchmark, KV caching sped up generation 11.2× over full recomputation, and a paged KV cache shares common prompt prefixes copy-on-write. In a GPU microbenchmark, INT8 matrix multiplication runs 1.60× faster than FP32. 136 tests.
- C++
- CUDA
- Python
- PyTorch
- LLM Serving
- Quantization
02
Consensa
Distributed Vector Database
A distributed vector database in Go: hand-written Raft consensus, an MVCC storage engine, HNSW vector search, range sharding with live splits, and cross-shard transactions across two 3-node replica groups. A chaos harness kills processes and partitions the network, then checks the histories for linearizability. Quorum intersection and range-key ownership are model-checked in TLA+. Local HNSW search returns 98.6% of the true top-10 matches in 156 µs on 5,000 synthetic vectors.
- Go
- Raft
- HNSW
- gRPC
- TLA+
- Distributed Systems
03
Anamnesis
Memory for AI Agents
A memory layer for AI agents on CockroachDB, built for the CockroachDB × AWS hackathon and deployed on AWS Lambda. Beliefs carry validity intervals, so the agent can answer what it believed last week. New beliefs are checked against old ones and contradictions supersede instead of overwriting, and every write is audited in the same SERIALIZABLE transaction.
- Python
- FastAPI
- CockroachDB
- AWS Lambda
- LLM Agents
04
Aegis
Predictive Observability Platform
Failure prediction and root-cause analysis for microservices. A Kafka event-time correlator traced the root cause in all 78 simulated incidents, and a gradient-boosted model warned a median 193 seconds before failure on 18 held-out simulated episodes, with shadow scoring and PSI drift monitoring around it.
- Python
- FastAPI
- Kafka
- Scikit-Learn
- Prometheus
05
ClearText API
Async ML Inference Platform
A FastAPI service that takes BERT inference off the request path: the API returns a task ID while batched Celery workers run the model. Repeat inputs are served from a model-versioned Redis cache, requests get a 503 with Retry-After when workers are down or the queue is full, and failed tasks land in a replayable dead-letter queue.
- FastAPI
- Celery
- Redis
- PostgreSQL
- BERT
06
Go + Java Auth Platform
Go · Java · Spring Boot
A Go auth service with rotating refresh tokens, reuse detection and a Redis JTI blacklist, consumed by a Java/Spring Boot API that validates each request over gRPC behind a token-hash Caffeine cache and a fail-closed Resilience4j circuit breaker. 61 tests (Testcontainers and in-process gRPC); k6 load test at ~92 req/s with 6 ms p50 across both services.
- Go
- Java
- Spring Boot
- gRPC
- JWT
- Redis
07
Radar–Camera Fusion for Real-Time Drone Detection
Python · PyTorch · YOLOv8n
Confidence-weighted late fusion of YOLOv8n detections with radar-inspired motion features, lifting precision from 0.91 to 0.94 (F1 0.92) at 8.3 FPS on CPU, with no GPU needed at inference time. An LSTM trajectory forecaster cut RMSE from 1.78 to 1.64 against a GRU baseline. Basis for two IEEE papers (ASIACONF 2026, C2I6 2025).
- Python
- PyTorch
- YOLOv8n
- LSTM
- CUDA (training)