Chenyuan Yang

Chenyuan Yang

PhD student at UIUC

About

I am Chenyuan Yang (杨晨源), a PhD student at UIUC advised by Prof. Lingming Zhang since 2022 Fall.

I received my B.S. degree with honors from the elite program in the Department of Computer Science & Technology at Nanjing University, advised by Prof. Yanyan Jiang.

My research focuses on enhancing the reliability of software systems, such as machine learning systems, compilers, and OS kernels. To achieve this, I employ a combination of testing, analysis, and verification techniques, with a particular emphasis on leveraging the power of large language models (LLMs).

To date, my work has uncovered over 400 previously unknown bugs in widely-used machine learning systems, including PyTorch, TensorFlow, JAX, as well as 9 CVEs for the Linux kernel.

Besides deep learning systems and the Linux kernel, I also reported more than 30 bugs for other open-source projects, such as NumPy, Moby, and VSCode-Vim.

Publications

  • [Preprint] TestEval: Benchmarking Large Language Models for Test Case Generation
    Wenhan Wang*, Chenyuan Yang*, Zhijie Wang*, Yuheng Huang, Zhaoyang Chu, Da Song, Lingming Zhang, An Ran Chen, Lei Ma
    (Preprint), June 2024. [paper] [code]
  • [Preprint] KernelGPT: Enhanced Kernel Fuzzing via Large Language Models
    Chenyuan Yang, Zijie Zhao, Lingming Zhang
    (Preprint), Dec 2023. [paper] [code]
  • WhiteFox: White-box Compiler Fuzzing Empowered by Large Language Models
    Chenyuan Yang, Yinlin Deng, Runyu Lu, Jiayi Yao, Jiawei Liu, Reyhaneh Jabbarvand, Lingming Zhang
    Object-Oriented Programming, Systems, Languages, and Applications 2024 (in PACM PL)
    (OOPSLA 2024), Oct 2024. [paper] [code]
  • Large Language Models are Edge-Case Generators: Crafting Unusual Programs for Fuzzing Deep Learning Libraries
    Yinlin Deng, Chunqiu Steven Xia, Chenyuan Yang, Shizhuo Zhang, Shujing Yang, Lingming Zhang
    46th International Conference on Software Engineering
    (ICSE 2024), April 2024. [paper]
  • Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models
    Yinlin Deng, Chunqiu Steven Xia, Haoran Peng, Chenyuan Yang, Lingming Zhang
    32nd International Symposium on Software Testing and Analysis
    (ISSTA 2023), July 2023. [paper]
  • Fuzzing Automatic Differentiation in Deep-Learning Libraries
    Chenyuan Yang, Yinlin Deng, Jiayi Yao, Yuxing Tu, Hanchi Li, Lingming Zhang
    45th International Conference on Software Engineering
    (ICSE 2023), May 2023. [paper] [code]
  • Fuzzing Deep-Learning Libraries via Automated Relational API Inference
    Yinlin Deng*, Chenyuan Yang*, Anjiang Wei, Lingming Zhang
    30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
    (ESEC/FSE 2022), Nov 2022. [paper] [code]
  • Free Lunch for Testing: Fuzzing Deep-Learning Libraries from Open Source
    Anjiang Wei, Yinlin Deng, Chenyuan Yang, Lingming Zhang
    44th International Conference on Software Engineering
    (ICSE 2022), May 2022. [paper] [code]

    • * denotes joint first authors

    Internships

    Microsoft Research, Systems Research Group Summmer 2024

    Google Labs, Project Starline Summmer 2023

    Talks

    Fuzzing Deep-Learning Libraries via Automated Relational API Inference

    • Software Engineering Retreat, University of Illinois at Urbana-Champaign, Sept. 2022

    Free Lunch for Testing: Fuzzing Deep-Learning Libraries from Open Source