Fri 25 Oct 2024 17:00 - 17:20 at IBR East - Testing Everything, Everywhere, All At Once Chair(s): Alex Potanin

Compilers are at the core of all computer architecture. Their middle-end and back-end are full of subtle code that is easy to get wrong. At the same time, the consequences of compiler bugs can be severe. Therefore, it is important that we develop techniques to increase our confidence in compiler correctness, and to help find the bugs that inevitably happen. One promising such technique that has successfully found many compiler bugs in the past is \emph{randomized differential testing}, a fuzzing approach whereby the same program is executed with different compilers or different compiler settings to detect any unexpected differences in behavior.

We present \emph{Rustlantis}, the first fuzzer for the Rust programming language that is able to find new correctness bugs in the official Rust compiler. To avoid having to deal with Rust’s strict type and borrow checker, Rustlantis directly generates MIR, the central IR of the Rust compiler for optimizations. The program generation strategy of Rustlantis is a combination of statically tracking the state of the program, obscuring the program state for the compiler, and \emph{decoy blocks} to lead optimizations astray. This has allowed us to identify 22 previously unknown bugs in the Rust compiler, most of which have been fixed.

Fri 25 Oct

Displayed time zone: Pacific Time (US & Canada) change

16:00 - 17:40
Testing Everything, Everywhere, All At OnceOOPSLA 2024 at IBR East
Chair(s): Alex Potanin Australian National University
16:00
20m
Talk
Crabtree: Rust API Test Synthesis Guided by Coverage and Type
OOPSLA 2024
Yoshiki Takashima Carnegie Mellon University, Chanhee Cho Carnegie Mellon University, Ruben Martins Carnegie Mellon University, Limin Jia , Corina S. Păsăreanu Carnegie Mellon University; NASA Ames
DOI
16:20
20m
Talk
Drowzee: Metamorphic Testing for Fact-conflicting Hallucination Detection in Large Language Models
OOPSLA 2024
Ningke Li Huazhong University of Science and Technology, Yuekang Li UNSW, Yi Liu Nanyang Technological University, Ling Shi Nanyang Technological University, Kailong Wang Huazhong University of Science and Technology, Haoyu Wang Huazhong University of Science and Technology
DOI
16:40
20m
Talk
Reward Augmentation in Reinforcement Learning for Testing Distributed Systems
OOPSLA 2024
Andrea Borgarelli Max Planck Institute for Software Systems, Constantin Enea LIX, CNRS, Ecole Polytechnique, Rupak Majumdar MPI-SWS, Srinidhi Nagendra CNRS, Université Paris Cité, IRIF, Chennai Mathematical Institute
DOI
17:00
20m
Talk
Rustlantis: Randomized Differential Testing of the Rust Compiler
OOPSLA 2024
Qian (Andy) Wang ETH Zurich and Imperial College London, Ralf Jung ETH Zurich
DOI
17:20
20m
Talk
Statistical Testing of Quantum Programs via Fixed-Point Amplitude Amplification
OOPSLA 2024
Chan Gu Kang Korea University, Joonghoon Lee Korea University, Hakjoo Oh Korea University
DOI