no code implementations • 7 Feb 2024 • Wenyu Liang, Pablo R. Baldivieso, Ross Drummond, Donghwan Shin
Often, the feedback control gains are simply passed from paper to paper with little re-tuning taking place, even though the changes to the neural networks can alter the vehicle's closed loop dynamics.
no code implementations • 11 Jan 2024 • Ziyu Li, Donghwan Shin
We apply different types of code mutations, such as operator replacement and statement deletion, to generate inconsistent code-description pairs.
no code implementations • 31 Jan 2023 • Sepehr Sharifi, Donghwan Shin, Lionel C. Briand, Nathan Aschbacher
In Machine Learning (ML)-enabled autonomous systems (MLASs), it is essential to identify the hazard boundary of ML Components (MLCs) in the MLAS under analysis.
no code implementations • 27 Oct 2022 • Fitash Ul Haq, Donghwan Shin, Lionel Briand
However, the environmental variables (e. g., lighting conditions) that might change during the systems' operation in the real world, causing the DES to violate requirements (safety, functional), are often kept constant during the execution of an online test scenario due to the two major challenges: (1) the space of all possible scenarios to explore would become even larger if they changed and (2) there are typically many requirements to test simultaneously.
no code implementations • 26 Jan 2021 • Fitash Ul Haq, Donghwan Shin, Shiva Nejati, Lionel Briand
Further, we cannot exploit offline testing results to reduce the cost of online testing in practice since we are not able to identify specific situations where offline testing could be as accurate as online testing in identifying safety requirement violations.
no code implementations • 12 Dec 2020 • Markus Borg, Raja Ben Abdessalem, Shiva Nejati, Francois-Xavier Jegeden, Donghwan Shin
Based on a minimalistic scene, we compare critical test scenarios generated using our SBST solution in these two simulators.
no code implementations • 11 Dec 2020 • Fitash Ul Haq, Donghwan Shin, Lionel C. Briand, Thomas Stifter, Jun Wang
In this paper, we present an approach to automatically generate test data for KP-DNNs using many-objective search.
no code implementations • 28 Nov 2019 • Fitash Ul Haq, Donghwan Shin, Shiva Nejati, Lionel Briand
Further, offline testing is more optimistic than online testing as many safety violations identified by online testing could not be identified by offline testing, while large prediction errors generated by offline testing always led to severe safety violations detectable by online testing.