Search Results for author: Donghwan Shin

Found 8 papers, 0 papers with code

Tuning the feedback controller gains is a simple way to improve autonomous driving performance

no code implementations7 Feb 2024 Wenyu Liang, Pablo R. Baldivieso, Ross Drummond, Donghwan Shin

Often, the feedback control gains are simply passed from paper to paper with little re-tuning taking place, even though the changes to the neural networks can alter the vehicle's closed loop dynamics.

Autonomous Driving

Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs

no code implementations11 Jan 2024 Ziyu Li, Donghwan Shin

We apply different types of code mutations, such as operator replacement and statement deletion, to generate inconsistent code-description pairs.

Code Generation

Identifying the Hazard Boundary of ML-enabled Autonomous Systems Using Cooperative Co-Evolutionary Search

no code implementations31 Jan 2023 Sepehr Sharifi, Donghwan Shin, Lionel C. Briand, Nathan Aschbacher

In Machine Learning (ML)-enabled autonomous systems (MLASs), it is essential to identify the hazard boundary of ML Components (MLCs) in the MLAS under analysis.

Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systems

no code implementations27 Oct 2022 Fitash Ul Haq, Donghwan Shin, Lionel Briand

However, the environmental variables (e. g., lighting conditions) that might change during the systems' operation in the real world, causing the DES to violate requirements (safety, functional), are often kept constant during the execution of an online test scenario due to the two major challenges: (1) the space of all possible scenarios to explore would become even larger if they changed and (2) there are typically many requirements to test simultaneously.

Autonomous Driving reinforcement-learning +1

Can Offline Testing of Deep Neural Networks Replace Their Online Testing?

no code implementations26 Jan 2021 Fitash Ul Haq, Donghwan Shin, Shiva Nejati, Lionel Briand

Further, we cannot exploit offline testing results to reduce the cost of online testing in practice since we are not able to identify specific situations where offline testing could be as accurate as online testing in identifying safety requirement violations.

Digital Twins Are Not Monozygotic -- Cross-Replicating ADAS Testing in Two Industry-Grade Automotive Simulators

no code implementations12 Dec 2020 Markus Borg, Raja Ben Abdessalem, Shiva Nejati, Francois-Xavier Jegeden, Donghwan Shin

Based on a minimalistic scene, we compare critical test scenarios generated using our SBST solution in these two simulators.

Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study

no code implementations28 Nov 2019 Fitash Ul Haq, Donghwan Shin, Shiva Nejati, Lionel Briand

Further, offline testing is more optimistic than online testing as many safety violations identified by online testing could not be identified by offline testing, while large prediction errors generated by offline testing always led to severe safety violations detectable by online testing.

DNN Testing

Cannot find the paper you are looking for? You can Submit a new open access paper.