// Backend & ML Systems Engineer

K Ashraf Ahmed

AI Systems & Backend Engineer.

12 merged PRs across 8 open-source repositories, including Zalando Skipper, CNCF etcd and CALL-E.

Associate Software Engineer @ The Jobs Jungle · Bengaluru, India · open to AI engineering, forward deployed and AI infrastructure roles

View my GitHub

Source code for every project

Current role
Associate Software Engineer, The Jobs Jungle · Aug 2026 – Present
Education
B.E in Computer Science and Engineering, New Horizon College of Engineering, Bengaluru · Nov 2022 – July 2026
Publications & awards
2 peer-reviewed IEEE papers · 3rd place, Global Innovation Build Challenge V2
Open to
AI engineering, forward deployed and AI infrastructure roles · Bengaluru, India

01 · Open Source

Merged upstream.

12 merged PRs across 8 open-source repositories, including Zalando Skipper, CNCF etcd and CALL-E.

weightedRoundRobin Load-Balancing Algorithm

zalando/skipperPR #4124+599/−43.1K+ stars

Designed and shipped a smooth weighted round-robin algorithm with dynamic health-derived endpoint weights. Defended the locking design under maintainer review with a self-built C benchmark harness sustaining ~31k req/s at 1,000 endpoints — the harness was kept in the repo for testing all algorithms.

View PR

lifoWithBody / lifoGroupWithBody — Concurrency-Limit Fix

zalando/skipperPR #4188+275/−173.1K+ stars

lifo released its concurrency queue slot as soon as the backend sent response headers, so a backend streaming a long body left the slot free and the route admitted past MaxConcurrency. Added lifoWithBody and lifoGroupWithBody that hold the slot until the body finishes streaming, using a separate state-bag key so a plain lifo() on the same route can't pop the release function early. The regression test fails against the old filters — they wrongly return 200 where the new ones correctly return 502 on queue timeout.

View PR

mobilize — Wave Dispatch Agent + MCP Server

CALLE-AI/awesome-phone-call-agentsPR #98+6,714CALL-E stars

Shipped an agent app and MCP server that treats a model's stated confirmation as a noisy signal rather than a fact — scoring call evidence against historical show-rate before it counts. A 300-trial evaluation harness against a synthetic population with known ground truth measured 94.6% accuracy for the calibrated policy vs 87.7% for trusting every stated yes. Crash-safe dispatch via a write-ahead ledger, verified with a real SIGKILL'd subprocess. 89 tests.

View PR

Prometheus Native Histogram Support

zalando/skipperPR #4108+245/−1463.1K+ stars

Added opt-in Prometheus native histograms behind a flag, with bucket limits set per the Prometheus and OTEL recommendations to bound memory. Classic histograms are still emitted alongside them, so existing dashboards and alerts keep working. Fixes #3898.

View PR

Per-Data-Client Load Latency Metrics

zalando/skipperPR #4087+76/−13.1K+ stars

Added instrumentation to measure route-loading latency per data source, giving SRE teams visibility into which integrations are slow.

View PR

TLS Certificate Matching Documentation

etcd-io/websitePR #1171+6/−348K+ stars

Clarified security documentation for certificate-matching semantics across v3.5–v3.7, resolving a 14-month-old confusion issue about wildcard support. Merged by a core maintainer.

View PR

Go Toolchain Security Updates

etcd-io/gofailPR #149+2/−2CNCF stars

Patched three CVEs by bumping Go to 1.25.11 as part of etcd organization's tracked security effort.

View PR

02 · Work Experience

Associate Software Engineer

The Jobs Jungle — AI-native applicant tracking system

Bengaluru, India · Aug 2026 – Present

40 → 2
extra database lookups per application page
−46%
job-list payload size
8
LLM call sites with token and cost tracking
5
production security vulnerabilities fixed
  • Shipped two paid AI features for recruiting agencies: a voice interviewer where OpenAI writes the questions and scores each answer, with guardrails that keep accent, age and other protected traits out of the score, and an LLM pipeline that searches the web and ranks candidates for a job.
  • Gave the team its first view of LLM spend by tracking tokens and estimated cost across 8 LLM call sites, and added prompt caching where identical requests were being re-sent.
  • Cut extra database lookups per application page from 40 to 2 and job-list payloads by 46%, built candidate data retention and erasure across 14 record types, and fixed 5 production security vulnerabilities.
  • Java 17
  • Spring Boot 3
  • MongoDB
  • JWT + OAuth2
  • JUnit
  • OpenAPI

03 · Personal Projects

Selected work.

Every project below is open source, with its code and README on GitHub.

Browse all repositories

01

Kiln

LLM Inference Engine

An LLM inference engine written in C++ with custom CUDA kernels for attention, RMSNorm and RoPE. It serves SmolLM2-135M at 219–231 tokens/s on a GTX 1660 Ti through an OpenAI-compatible API (one request at a time), with final logits within ~6×10⁻⁵ of Hugging Face on two checkpoints. In a CPU benchmark, KV caching sped up generation 11.2× over full recomputation, and a paged KV cache shares common prompt prefixes copy-on-write. In a GPU microbenchmark, INT8 matrix multiplication runs 1.60× faster than FP32. 136 tests.

  • C++
  • CUDA
  • Python
  • PyTorch
  • LLM Serving
  • Quantization

02

Consensa

Distributed Vector Database

A distributed vector database in Go: hand-written Raft consensus, an MVCC storage engine, HNSW vector search, range sharding with live splits, and cross-shard transactions across two 3-node replica groups. A chaos harness kills processes and partitions the network, then checks the histories for linearizability. Quorum intersection and range-key ownership are model-checked in TLA+. Local HNSW search returns 98.6% of the true top-10 matches in 156 µs on 5,000 synthetic vectors.

  • Go
  • Raft
  • HNSW
  • gRPC
  • TLA+
  • Distributed Systems

03

Anamnesis

Memory for AI Agents

A memory layer for AI agents on CockroachDB, built for the CockroachDB × AWS hackathon and deployed on AWS Lambda. Beliefs carry validity intervals, so the agent can answer what it believed last week. New beliefs are checked against old ones and contradictions supersede instead of overwriting, and every write is audited in the same SERIALIZABLE transaction.

  • Python
  • FastAPI
  • CockroachDB
  • AWS Lambda
  • LLM Agents

04

Aegis

Predictive Observability Platform

Failure prediction and root-cause analysis for microservices. A Kafka event-time correlator traced the root cause in all 78 simulated incidents, and a gradient-boosted model warned a median 193 seconds before failure on 18 held-out simulated episodes, with shadow scoring and PSI drift monitoring around it.

  • Python
  • FastAPI
  • Kafka
  • Scikit-Learn
  • Prometheus

05

ClearText API

Async ML Inference Platform

A FastAPI service that takes BERT inference off the request path: the API returns a task ID while batched Celery workers run the model. Repeat inputs are served from a model-versioned Redis cache, requests get a 503 with Retry-After when workers are down or the queue is full, and failed tasks land in a replayable dead-letter queue.

  • FastAPI
  • Celery
  • Redis
  • PostgreSQL
  • BERT

06

Go + Java Auth Platform

Go · Java · Spring Boot

A Go auth service with rotating refresh tokens, reuse detection and a Redis JTI blacklist, consumed by a Java/Spring Boot API that validates each request over gRPC behind a token-hash Caffeine cache and a fail-closed Resilience4j circuit breaker. 61 tests (Testcontainers and in-process gRPC); k6 load test at ~92 req/s with 6 ms p50 across both services.

  • Go
  • Java
  • Spring Boot
  • gRPC
  • JWT
  • Redis

07

Radar–Camera Fusion for Real-Time Drone Detection

Python · PyTorch · YOLOv8n

Confidence-weighted late fusion of YOLOv8n detections with radar-inspired motion features, lifting precision from 0.91 to 0.94 (F1 0.92) at 8.3 FPS on CPU, with no GPU needed at inference time. An LSTM trajectory forecaster cut RMSE from 1.78 to 1.64 against a GRU baseline. Basis for two IEEE papers (ASIACONF 2026, C2I6 2025).

  • Python
  • PyTorch
  • YOLOv8n
  • LSTM
  • CUDA (training)

04 · Skills & Tech Stack

The stack, in orbit.

Each ring on the right is one group below. Hover a group to light up its ring, or hover a gem to read its name.

Languages

  • Python
  • Go
  • Java
  • C
  • C++
  • JavaScript
  • TypeScript

Backend

  • FastAPI
  • Spring Boot
  • Gin
  • gRPC
  • Kafka
  • REST APIs
  • OAuth2
  • JWT
  • Celery
  • Async Processing
  • Event-Driven Architecture

Databases & Storage

  • PostgreSQL
  • Redis
  • MongoDB
  • SQLite
  • LSM-tree
  • WAL

Systems

  • Distributed Systems
  • Raft Consensus
  • Caching
  • Rate Limiting
  • Task Queues
  • Stream Processing
  • Observability
  • Concurrency
  • Fault Tolerance

Tools

  • Docker
  • GitHub Actions
  • AWS Lambda
  • Locust
  • Pytest
  • Git
  • OpenAI API

Core

  • DSA
  • System Design
  • Performance Benchmarking
  • Load Testing

ML / AI

  • BERT
  • YOLOv8
  • CUDA
  • PyTorch
  • LSTM
  • LLM Serving
  • KV Caching
  • Quantization (INT8/INT4)
  • LoRA Fine-Tuning
  • Vector Search (HNSW)
  • Model Evaluation
  • MLOps
  • Drift Monitoring (PSI)
  • MCP

05 · About

About.

Software engineer in Bengaluru working on AI systems and the backends under them. At The Jobs Jungle I build AI features for an applicant-tracking product in Java and Spring Boot: a voice interviewer, a candidate-sourcing pipeline and the cost tracking around our LLM calls. On my own time I build infrastructure from first principles: Kiln, an LLM inference engine in C++ and CUDA, and Consensa, a distributed vector database in Go with hand-written Raft. I also contribute to Zalando Skipper, CNCF etcd and CALL-E.

Education

New Horizon College of Engineering, Bengaluru

B.E in Computer Science and Engineering | GPA: 7.71 | Nov 2022 – July 2026

Coursework: Data Structures & Algorithms, Design & Analysis of Algorithms, Operating Systems, Computer Networks, Database Management Systems, Linux System Programming, Computer Architecture (ARM), Machine Learning, Generative AI, Cloud Architecture & Security

Publications

  • IEEE ASIACONF 2026 — "Lightweight Radar-Camera Fusion for Real-Time Drone Detection and Trajectory Prediction" (peer-reviewed): confidence-weighted late fusion of YOLOv8n with radar-inspired features lifted precision 0.91 → 0.94 at 8.3 FPS CPU-only inference.
  • IEEE C2I6 2025 — "Lightweight Real-Time Drone Detection and Trajectory Forecasting Using YOLOv8 and LSTM Networks" (peer-reviewed): mAP 0.89 at ~9 FPS CPU-only inference.

Awards

  • Global Innovation Build Challenge V2 (2026) — 3rd place (Bronze)
    Medical Tech & Finance track. In a historical backtest on Q3 2022 filings, Marked ranked Silicon Valley Bank #1 of 4,713 US banks for run risk. Marked

06 · Contact

Get in Touch.

Interested in working together or have a question? I'd love to hear from you.