Job Title: AI Research Engineer – Deep Learning Inference
Location: New York, NY | London, UK
About the Opportunity
Join an industry-leading global quantitative technology organization at the forefront of machine learning innovation. We are seeking a High-Performance AI Research Engineer to drive speed and scalability across our real-time predictive modeling infrastructure. In this role, you will bridge the gap between machine learning research and hardware acceleration, building low-latency inference systems that process continuous global data streams to drive core business decisions.
Responsibilities
-
Drive performance optimizations across all aspects of large-scale model execution, including custom kernel creation, data streaming pipelines, and novel hardware integration.
-
Partner directly with machine learning researchers to co-design neural architectures optimized for extreme real-time execution.
-
Author low-level primitives and custom operations to extract maximum compute throughput from modern hardware architectures.
-
Evaluate, benchmark, and deploy novel hardware acceleration tech, ranging from off-the-shelf accelerators to custom specialized silicon.
-
Formulate and execute engineering initiatives that address complex, non-obvious bottlenecks in ultra-low-latency deep learning inference.
Requirements (Must-Have)
-
At least two years of hands-on experience engineering production-grade deep learning systems within any complex domain (such as robotics, computer vision, audio, NLP, physics, or recommender platforms).
-
Strong lower-level engineering foundation, including experience writing custom compute kernels (e.g., CUDA, Triton, Pallas, or CuTe DSLs).
-
Proficiency with framework compilation internals and low-level runtime environments (PyTorch, JAX, XLA, or CUDA Graphs).
-
Practical exposure to hardware acceleration tech, such as FPGAs, ASICs, or specialized AI processors.
-
Proven ability to adapt algorithms and technical concepts across different domain applications.
Preferred Qualifications
-
Experience optimizing or serving Large Language Models (LLMs) and foundation architectures.
-
Note: Prior background in quantitative finance or trading is explicitly NOT required.
Compensation & Benefits
-
Highly competitive base salary, performance-based bonus incentive, and premium health/wellness benefits package. Equal Opportunity Employer.


