ARAhmad Rezaei

Ahmad Rezaei

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Ahmad Rezaei has a total of 19 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Automatic Kernel Generation with Large Language Models: Taxonomies, Evaluations, and Cross-Platform Challenges

    by Kevin Cannons, Ahmad Rezaei, Saeed Ranjbar Alvar, Mohsen Gholami, Zongzuo Wang, Zheng Shen, Boxing Chen, Yong Zhang, Yi Jiang, Mohammad Akbari

    Large language models (LLMs) have recently emerged as a promising tool for automatic generation and optimization of high-performance compute kernels. This rapidly growing area spans across hardware platforms and targets programming models such as AscendC, CUDA, and Triton. However, the literature remains fragmented, with substantial variation in generation workflows, training strategies, evaluation protocols, benchmark assumptions, hardware platforms, and reported metrics. This survey provides a structured review of LLM-based automatic kernel generation. We introduce a taxonomy based on the generation-time workflow, separating direct generation, refinement via structured feedback, search-based generation, and adaptive tool-orchestrating agentic systems. We further analyze orthogonal design axes including learning strategy, input representation, output representation, and hardware platform. Beyond method classification, we examine evaluation practices, including benchmark data, harnesses, integrity policies, as well as performance metrics, and discuss why reported results are often difficult to compare. Finally, we use Ascend NPU kernel generation as a cross-platform case study, highlighting challenges introduced by AscendC, host-device co-design, toolchain constraints, and limited public data. We conclude by identifying open problems in robust evaluation, higher-level task optimization, cross-platform transfer, production deployment, and benchmark design.

  • Open Access

    CPPO: Contrastive Perception for Vision Language Policy Optimization

    by Ahmad Rezaei, Mohsen Gholami, Saeed Ranjbar Alvar, Kevin Cannons, Mohammad Asiful Hossain, Zhou Weimin, Shunbo Zhou, Yong Zhang, Mohammad Akbari

    We introduce CPPO, a Contrastive Perception Policy Optimization method for finetuning vision-language models (VLMs). While reinforcement learning (RL) has advanced reasoning in language models, extending it to multimodal reasoning requires improving both the perception and reasoning aspects. Prior works tackle this challenge mainly with explicit perception rewards, but disentangling perception tokens from reasoning tokens is difficult, requiring extra LLMs, ground-truth data, forced separation of perception from reasoning by policy model, or applying rewards indiscriminately to all output tokens. CPPO addresses this problem by detecting perception tokens via entropy shifts in the model outputs under perturbed input images. CPPO then extends the RL objective function with a Contrastive Perception Loss (CPL) that enforces consistency under information-preserving perturbations and sensitivity under information-removing ones. Experiments show that CPPO surpasses previous perception-rewarding methods, while avoiding extra models, making training more efficient and scalable.

  • Open Access

    Task-Agnostic Language Model Watermarking via High Entropy Passthrough Layers

    by Vaden Masrani, Mohammad Akbari, David Ming Xuan Yue, Ahmad Rezaei, Yong Zhang

    In the era of costly pre-training of large language models, ensuring the intellectual property rights of model owners, and insuring that said models are responsibly deployed, is becoming increasingly important. To this end, we propose model watermarking via passthrough layers, which are added to existing pre-trained networks and trained using a self-supervised loss such that the model produces high-entropy output when prompted with a unique private key, and acts normally otherwise. Unlike existing model watermarking methods, our method is fully task-agnostic, and can be applied to both classification and sequence-to-sequence tasks without requiring advanced access to downstream fine-tuning datasets. We evaluate the proposed passthrough layers on a wide range of downstream tasks, and show experimentally our watermarking method achieves a near-perfect watermark extraction accuracy and false-positive rate in most cases without damaging original model performance. Additionally, we show our method is robust to both downstream fine-tuning, fine-pruning, and layer removal attacks, and can be trained in a fraction of the time required to train the original model. Code is available in the paper.