Abhishek has professional experience working as a Software Engineer and as a Deep Learning Engineer over the past 8 years at big technology companies such as Amazon, AMD, Samsung, MediaTek, MathWorks, and Continental Automotive. Currently, Abhishek is working at Amazon where he is focused on deploying large language models (LLMs) on edge devices. In this role, Abhishek is responsible for optimizing the performance, efficiency, and memory footprint of these complex LLMs to enable real-time, on-device inference. Abhishek's work involves leveraging techniques like model quantization, compression, pruning, distillation, latency hiding etc., to deploy LLMs on the edge without sacrificing accuracy.