Shivam Dubey

AI researcher working on mechanistic interpretability, adversarial robustness and white-box AI control.

Research experience

Jul 2026 – now

MARS V, Meridian AI Research Summer · Fellow
Lindley Lentati track: White-Box Techniques for AI Control. Cambridge

Trained linear compliance probes on residual-stream activations across four instruction-tuned models from three labs. Ran a red-team/blue-team co-evolution loop against them across three attack families; the main result is negative: jailbreak success and probe evasion are mutually exclusive. The deployment lesson is the false positive rate: probes do find the jailbreak direction, but every probe keeps a false positive rate, so deployment needs a monitor cascade rather than one probe. Extending into trained attack policies behind a six-stage de-risking protocol. Multi-GPU SLURM cluster (8×B200), shared codebase with one collaborator. The harness is open source: Whetstone.

2026 – now

Redarc Labs · Co-founder and Research Lead
Delhi

An AI safety research lab, co-founded with Manan Wadhwa; our joint papers come from it. We started with interpretability for existential risk (four accepted workshop papers in 2026, one under review). The focus now is control and interpretability for non-model capability gains: what an agent can do because of its harness rather than its weights.

Run a six-person research fellowship. Cohort 01 is built around one thesis: expressed confidence in LLMs is separable from internal knowledge. Mentoring three first-author workshop projects; two papers under review at NeurIPS 2026 workshops. Wrote and teach Redarc Fellows, an eight-session mechanistic interpretability curriculum taught with PyTorch hooks and Hugging Face directly, no wrapper libraries.

2026 – now

Secure AI Futures Lab · Special Projects Fellow
Delhi hub

Teaching the Redarc Labs mechanistic interpretability bootcamp in person, and running reading groups on the weekends.

2026 – now

Lexsi Labs
Tabular Foundation Models Lab

Capability research on tabular foundation models: attributing model behavior back to synthetic pretraining data. Two papers at the ATTRIB workshop, NeurIPS 2026, and one at FMSD, ICML 2026. Listed here.

Nov 2025 – now

Apart Research · Research Fellow
Mentor: Jason Hoelscher-Obermaier · lead author, accepted at TAIS 2026, Oxford

Measured geometric divergence of ViTs and ResNets under seven adversarial attack algorithms using Hutchinson's stochastic Hessian trace estimator. Found a five-order-of-magnitude discrepancy between input-space and parameter-space curvature, showing that standard robustness metrics misclassify internal model instability.

Jan 2025 – Apr 2026

Artificial Intelligence Institute of South Carolina · Research Intern
Mentor: Dr. Amitava Das

Co-author of AMBEDKAR (arXiv:2509.02133, cited by MIT Technology Review). Designed the fairness-aware speculative decoding algorithm, which reduces religion bias by 77% and caste bias by 23% at 6% latency overhead.

Publications

Full descriptions on the AI safety and AI capability pages. Papers with Manan Wadhwa come from Redarc Labs.

Peer-reviewed and accepted

Under review and in preparation

Open-source tooling

Education

2023 – 2027

BS in Data Science
Indian Institute of Technology Madras

Focus: AI safety, interpretability, fairness, governance.

2022 – 2026

B.Tech in Mechanical and Automation Engineering
Maharaja Agrasen Institute of Technology, Delhi

Teaching

2026

Redarc Fellows
Eight-session mechanistic interpretability cohort

Written and taught by me, with PyTorch hooks and Hugging Face directly and no interpretability library in the stack. The curriculum is here.

Technical skills

Languages

Python, CUDA, MATLAB, Bash, JavaScript

Frameworks

PyTorch, JAX, TransformerLens, NNsight, Hugging Face, DevInterp, LangChain, Docker, SLURM (multi-node, 8×B200)

Methods

QK/OV circuit decomposition, direct logit attribution, activation patching, steering vectors (CAA), logit lens, linear probing, SAE feature attribution, nanoGCG and suffix-gradient attacks, Hutchinson Hessian trace, SVD and spectral dynamics