Search Results for author: Zhiyu Lin

Found 14 papers, 4 papers with code

AIGCs Confuse AI Too: Investigating and Explaining Synthetic Image-induced Hallucinations in Large Vision-Language Models

no code implementations13 Mar 2024 YiFei Gao, Jiaqi Wang, Zhiyu Lin, Jitao Sang

Remarkably, our findings shed light on a consistent AIGC \textbf{hallucination bias}: the object hallucinations induced by synthetic images are characterized by a greater quantity and a more uniform position distribution, even these synthetic images do not manifest unrealistic or additional relevant visual features compared to natural images.

Hallucination

An Ontology of Co-Creative AI Systems

no code implementations11 Oct 2023 Zhiyu Lin, Mark Riedl

The term co-creativity has been used to describe a wide variety of human-AI assemblages in which human and AI are both involved in a creative endeavor.

A Controllable Co-Creative Agent for Game System Design

no code implementations4 Aug 2023 Rohan Agarwal, Zhiyu Lin, Mark Riedl

Many advancements have been made in procedural content generation for games, and with mixed-initiative co-creativity, have the potential for great benefits to human designers.

Towards Black-box Adversarial Example Detection: A Data Reconstruction-based Method

no code implementations3 Jun 2023 YiFei Gao, Zhiyu Lin, Yunfan Yang, Jitao Sang

Black-box attack, which is a more realistic threat and has led to various black-box adversarial training-based defense methods, however, does not attract considerable attention in adversarial example detection.

Adversarial Defense

Beyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity Systems

1 code implementation3 May 2023 Zhiyu Lin, Upol Ehsan, Rohan Agarwal, Samihan Dani, Vidushi Vashishth, Mark Riedl

We find out that MI-CC systems with more extensive coverage of the design space are rated higher or on par on a variety of creative and goal-completion metrics, demonstrating that wider coverage of the design space can improve user experience and achievement when using the system; Preference varies greatly between expertise groups, suggesting the development of adaptive, personalized MI-CC systems; Participants identified new design space dimensions including scrutability -- the ability to poke and prod at models -- and explainability.

Neuro-Symbolic World Models for Adapting to Open World Novelty

no code implementations16 Jan 2023 Jonathan Balloch, Zhiyu Lin, Robert Wright, Xiangyu Peng, Mustafa Hussain, Aarun Srinivas, Julia Kim, Mark O. Riedl

Additionally, WorldCloner augments the policy learning process using imagination-based adaptation, where the world model simulates transitions of the post-novelty environment to help the policy adapt.

Decision Making reinforcement-learning +1

Creative Wand: A System to Study Effects of Communications in Co-Creative Settings

1 code implementation4 Aug 2022 Zhiyu Lin, Rohan Agarwal, Mark Riedl

Recent neural generation systems have demonstrated the potential for procedurally generating game content, images, stories, and more.

Investigating and Explaining the Frequency Bias in Image Classification

1 code implementation6 May 2022 Zhiyu Lin, YiFei Gao, Jitao Sang

Specifically, our investigations verify that the spectral density of datasets mainly affects the learning priority, while the class consistency mainly affects the feature discrimination.

Classification Image Classification

NovGrid: A Flexible Grid World for Evaluating Agent Response to Novelty

no code implementations23 Mar 2022 Jonathan Balloch, Zhiyu Lin, Mustafa Hussain, Aarun Srinivas, Robert Wright, Xiangyu Peng, Julia Kim, Mark Riedl

We provide an ontology of for novelties most relevant to sequential decision making, which distinguishes between novelties that affect objects versus actions, unary properties versus non-unary relations, and the distribution of solutions to a task.

Decision Making reinforcement-learning +1

Benign Adversarial Attack: Tricking Models for Goodness

no code implementations26 Jul 2021 Jitao Sang, Xian Zhao, Jiaming Zhang, Zhiyu Lin

In spite of the successful application in many fields, machine learning models today suffer from notorious problems like vulnerability to adversarial examples.

Adversarial Attack Attribute +2

Explore, Exploit or Listen: Combining Human Feedback and Policy Model to Speed up Deep Reinforcement Learning in 3D Worlds

no code implementations12 Sep 2017 Zhiyu Lin, Brent Harrison, Aaron Keech, Mark O. Riedl

We describe a method to use discrete human feedback to enhance the performance of deep learning agents in virtual three-dimensional environments by extending deep-reinforcement learning to model the confidence and consistency of human feedback.

reinforcement-learning Reinforcement Learning (RL)

A Hierarchical Distributed Processing Framework for Big Image Data

no code implementations3 Jul 2016 Le Dong, Zhiyu Lin, Yan Liang, Ling He, Ning Zhang, Qi Chen, Xiaochun Cao, Ebroul lzquierdo

The proposed ICP framework consists of two mechanisms, i. e. SICP (Static ICP) and DICP (Dynamic ICP).

Cannot find the paper you are looking for? You can Submit a new open access paper.