Hi, I'm Ishaan 👋

ML systems engineer focused on inference, GPU kernels, and compilers.

Ishaan Goyal

Founding Engineer Intern, ML at A Vinyl Bar in Shibuya.

UIUC Computer Science, May 2027.

Work Experience

A Vinyl Bar in Shibuya

A Vinyl Bar in Shibuya

Founding Engineer Intern, ML

Built production music ML systems that support more than 1 million songs.

Python
PyTorch
MLX
Quantization
On-Device ML
ADAPT Lab, UIUC

ADAPT Lab, UIUC

Compiler Researcher

Accelerated a compiler critical path by 51 times.

Neural Network Verification
Compiler Optimization
JIT
Caching
GPU Architecture

Featured Systems Work

Selected projects

View all 14 projects
Diagram of tokens routed through a top-1 MoE layer and a fused Pallas projection kernel.
JAX Transformer + MoE Kernel Optimization
AI/ML

Improved MoE forward-pass speed by approximately 1.3 times against the ragged-dot baseline.

Built a decoder-only Transformer and a fused MoE projection kernel in JAX and Pallas.

JAX
Flax
Optax
TPU
Diagram of draft tokens that a larger model verifies during speculative decoding.
Speculative Decoding Systems Reproduction
AI/ML

Raised throughput by 1.3 to 1.6 times and lowered latency by 15 to 20 percent.

Built a draft-and-verify runtime for standard and Speculative2 decoding with Qwen3 models.

PyTorch
CUDA
Qwen3
KV Cache
Diagram of GPT-2 inference with CUDA matrix multiplication and a key-value cache.
GPT-2 Inference Optimization
AI/ML

Reduced matmul latency by 10 to 13 percent and changed decode complexity from O(T^2) to O(T).

Optimized GPT-2 inference on an NVIDIA A40 with CUDA kernels and KV caching.

C++
CUDA
Slurm
Nsight
Ren IDE interface with an agent panel, a code editor, and an architecture graph.
Ren - Agentic IDE
Developer Tools

Supported more than 1,200 AI-assisted edits for more than 50 alpha users.

Built a VS Code-based agentic IDE with multi-agent execution, indexing, review, and observability.

TypeScript
VS Code
Bun
Hono

Education

University of Illinois Urbana-Champaign

University of Illinois Urbana-Champaign

Bachelor of Science in Computer Science

Studies computer science with a focus on systems, architecture, and machine learning.

Skills

Languages

C
C++
CUDA C++
Python
Go
Java

ML and AI Systems

PyTorch
JAX
Flax
Optax
TensorFlow
Hugging Face

Inference and Kernel Optimization

CUDA
cuBLAS
cuDNN
NCCL
WMMA
Tensor Cores

Systems, Compiler, and Infrastructure

Linux
Slurm
Docker
Kubernetes
Git
CMake
Show All Skills

Languages

JavaScript/TypeScript
Verilog
Bash
SQL

ML and AI Systems

MLX
Core ML
LoRA/PEFT
MoE
MTP
Speculative Decoding
KV Cache
FlashAttention
Quantization
RLHF
Pallas

Inference and Kernel Optimization

Pallas Kernels
KV-Cache Management
Batching
Token Routing
Prompt-Lookup Decoding
INT4/INT8/FP8 Quantization

Systems, Compiler, and Infrastructure

gdb
perf
Nsight
nsys
JIT Compilation
Caching
Profiling
OpenMP
MPI
AWS
GCP
Redis
PostgreSQL
Elasticsearch
Kafka
gRPC
Protobuf
WebSockets
RabbitMQ
Apache Airflow

Contact

Build something ambitious.

Send me an email about AI infrastructure, systems, or ambitious products.

ishaan6@illinois.edu