Publications

[Preprint] TestEval: Benchmarking Large Language Models for Test Case Generation
Wenhan Wang*, Chenyuan Yang*, Zhijie Wang*, Yuheng Huang, Zhaoyang Chu, Da Song, Lingming Zhang, An Ran Chen, Lei Ma
(Preprint), June 2024. [paper] [code]

[Preprint] KernelGPT: Enhanced Kernel Fuzzing via Large Language Models
Chenyuan Yang, Zijie Zhao, Lingming Zhang
(Preprint), Dec 2023. [paper] [code]

WhiteFox: White-box Compiler Fuzzing Empowered by Large Language Models
Chenyuan Yang, Yinlin Deng, Runyu Lu, Jiayi Yao, Jiawei Liu, Reyhaneh Jabbarvand, Lingming Zhang
Object-Oriented Programming, Systems, Languages, and Applications 2024 (in PACM PL)
(OOPSLA 2024), Oct 2024. [paper] [code]

Large Language Models are Edge-Case Generators: Crafting Unusual Programs for Fuzzing Deep Learning Libraries
Yinlin Deng, Chunqiu Steven Xia, Chenyuan Yang, Shizhuo Zhang, Shujing Yang, Lingming Zhang
46th International Conference on Software Engineering
(ICSE 2024), April 2024. [paper]

Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models
Yinlin Deng, Chunqiu Steven Xia, Haoran Peng, Chenyuan Yang, Lingming Zhang
32nd International Symposium on Software Testing and Analysis
(ISSTA 2023), July 2023. [paper]

Fuzzing Automatic Differentiation in Deep-Learning Libraries
Chenyuan Yang, Yinlin Deng, Jiayi Yao, Yuxing Tu, Hanchi Li, Lingming Zhang
45th International Conference on Software Engineering
(ICSE 2023), May 2023. [paper] [code]

Fuzzing Deep-Learning Libraries via Automated Relational API Inference
Yinlin Deng*, Chenyuan Yang*, Anjiang Wei, Lingming Zhang
30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
(ESEC/FSE 2022), Nov 2022. [paper] [code]

Free Lunch for Testing: Fuzzing Deep-Learning Libraries from Open Source
Anjiang Wei, Yinlin Deng, Chenyuan Yang, Lingming Zhang
44th International Conference on Software Engineering
(ICSE 2022), May 2022. [paper] [code]

* denotes joint first authors