Search Results for author: Guannan Zhang

Found 38 papers, 9 papers with code

Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation

1 code implementation31 Mar 2024 Minglei Yang, Pengjun Wang, Ming Fan, Dan Lu, Yanzhao Cao, Guannan Zhang

We introduce a conditional pseudo-reversible normalizing flow for constructing surrogate models of a physical model polluted by additive noise to efficiently quantify forward and inverse uncertainty propagation.

Multi-Intent Attribute-Aware Text Matching in Searching

no code implementations12 Feb 2024 Mingzhe Li, Xiuying Chen, Jing Xiang, Qishen Zhang, Changsheng Ma, Chenchen Dai, Jinxiong Chang, Zhongyi Liu, Guannan Zhang

Since attributes from two ends are often not aligned in terms of number and type, we propose to exploit the benefit of attributes by multiple-intent modeling.

Attribute Text Matching

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts

no code implementations31 Jan 2024 Zhitian Xie, Yinger Zhang, Chenyi Zhuang, Qitao Shi, Zhining Liu, Jinjie Gu, Guannan Zhang

However, the gate's routing mechanism also gives rise to narrow vision: the individual MoE's expert fails to use more samples in learning the allocated sub-task, which in turn limits the MoE to further improve its generalization ability.

End-to-end Learnable Clustering for Intent Learning in Recommendation

1 code implementation11 Jan 2024 Yue Liu, Shihao Zhu, Jun Xia, Yingwei Ma, Jian Ma, Wenliang Zhong, Xinwang Liu, Guannan Zhang, Kejun Zhang

Concretely, we encode users' behavior sequences and initialize the cluster centers (latent intents) as learnable neurons.

Clustering Contrastive Learning +2

Improving the Expressive Power of Deep Neural Networks through Integral Activation Transform

no code implementations19 Dec 2023 Zezhong Zhang, Feng Bao, Guannan Zhang

The impressive expressive power of deep neural networks (DNNs) underlies their widespread applicability.

Multiple Instance Learning for Uplift Modeling

no code implementations15 Dec 2023 Yao Zhao, Haipeng Zhang, Shiwei Lyu, Ruiying Jiang, Jinjie Gu, Guannan Zhang

Uplift modeling is widely used in performance marketing to estimate effects of promotion campaigns (e. g., increase of customer retention rate).

Marketing Multiple Instance Learning

GreenFlow: A Computation Allocation Framework for Building Environmentally Sound Recommendation System

no code implementations15 Dec 2023 Xingyu Lu, Zhining Liu, Yanchu Guan, Hongxuan Zhang, Chenyi Zhuang, Wenqi Ma, Yize Tan, Jinjie Gu, Guannan Zhang

of a cascade RS, when a user triggers a request, we define two actions that determine the computation: (1) the trained instances of models with different computational complexity; and (2) the number of items to be inferred in the stage.

Recommendation Systems

Making Large Language Models Better Knowledge Miners for Online Marketing with Progressive Prompting Augmentation

no code implementations8 Dec 2023 Chunjing Gan, Dan Yang, Binbin Hu, Ziqi Liu, Yue Shen, Zhiqiang Zhang, Jinjie Gu, Jun Zhou, Guannan Zhang

In this paper, we seek to carefully prompt a Large Language Model (LLM) with domain-level knowledge as a better marketing-oriented knowledge miner for marketing-oriented knowledge graph construction, which is however non-trivial, suffering from several inevitable issues in real-world marketing scenarios, i. e., uncontrollable relation generation of LLMs, insufficient prompting ability of a single prompt, the unaffordable deployment cost of LLMs.

graph construction Language Modelling +3

A Multi-Granularity-Aware Aspect Learning Model for Multi-Aspect Dense Retrieval

1 code implementation5 Dec 2023 Xiaojie Sun, Keping Bi, Jiafeng Guo, Sihui Yang, Qishen Zhang, Zhongyi Liu, Guannan Zhang, Xueqi Cheng

Dense retrieval methods have been mostly focused on unstructured text and less attention has been drawn to structured data with various aspects, e. g., products with aspects such as category and brand.

Language Modelling Retrieval +1

ULMA: Unified Language Model Alignment with Human Demonstration and Point-wise Preference

1 code implementation5 Dec 2023 Tianchi Cai, Xierui Song, Jiyan Jiang, Fei Teng, Jinjie Gu, Guannan Zhang

Aligning language models to human expectations, e. g., being helpful and harmless, has become a pressing challenge for large language models.

Language Modelling Large Language Model

PEACE: Prototype lEarning Augmented transferable framework for Cross-domain rEcommendation

no code implementations4 Dec 2023 Chunjing Gan, Bo Huang, Binbin Hu, Jian Ma, Ziqi Liu, Zhiqiang Zhang, Jun Zhou, Guannan Zhang, Wenliang Zhong

To help merchants/customers to provide/access a variety of services through miniapps, online service platforms have occupied a critical position in the effective content delivery, in which how to recommend items in the new domain launched by the service provider for customers has become more urgent.

Recommendation Systems

PrivateLoRA For Efficient Privacy Preserving LLM

no code implementations23 Nov 2023 Yiming Wang, Yu Lin, Xiaodong Zeng, Guannan Zhang

To our knowledge, our proposed framework is the first efficient and privacy-preserving LLM solution in the literature.

Language Modelling Large Language Model +1

MultiLoRA: Democratizing LoRA for Better Multi-Task Learning

no code implementations20 Nov 2023 Yiming Wang, Yu Lin, Xiaodong Zeng, Guannan Zhang

Further investigation into weight update matrices of MultiLoRA exhibits reduced dependency on top singular vectors and more democratic unitary transform contributions.

Multi-Task Learning Natural Language Understanding +1

Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory

no code implementations15 Nov 2023 Lei Liu, Xiaoyan Yang, Yue Shen, Binbin Hu, Zhiqiang Zhang, Jinjie Gu, Guannan Zhang

Memory-augmented Large Language Models (LLMs) have demonstrated remarkable performance in long-term human-machine interactions, which basically relies on iterative recalling and reasoning of history to generate high-quality responses.

Diffusion-Model-Assisted Supervised Learning of Generative Models for Density Estimation

no code implementations22 Oct 2023 Yanfang Liu, Minglei Yang, Zezhong Zhang, Feng Bao, Yanzhao Cao, Guannan Zhang

Unlike existing diffusion models that train neural networks to learn the score function, we develop a training-free score estimation method.

Density Estimation

An Unified Search and Recommendation Foundation Model for Cold-Start Scenario

no code implementations16 Sep 2023 Yuqi Gong, Xichen Ding, Yehui Su, Kaiming Shen, Zhongyi Liu, Guannan Zhang

With the development of large language models, LLM can extract global domain-invariant text features that serve both search and recommendation tasks.

Recommendation Systems Transfer Learning

Marketing Budget Allocation with Offline Constrained Deep Reinforcement Learning

no code implementations6 Sep 2023 Tianchi Cai, Jiyan Jiang, Wenpeng Zhang, Shiji Zhou, Xierui Song, Li Yu, Lihong Gu, Xiaodong Zeng, Jinjie Gu, Guannan Zhang

We further show that this method is guaranteed to converge to the optimal policy, which cannot be achieved by previous value-based reinforcement learning methods for marketing budget allocation.

Marketing reinforcement-learning

An Ensemble Score Filter for Tracking High-Dimensional Nonlinear Dynamical Systems

1 code implementation2 Sep 2023 Feng Bao, Zezhong Zhang, Guannan Zhang

A major drawback of existing filtering methods, e. g., particle filters or ensemble Kalman filters, is the low accuracy in handling high-dimensional and highly nonlinear problems.

Model-free Reinforcement Learning with Stochastic Reward Stabilization for Recommender Systems

no code implementations25 Aug 2023 Tianchi Cai, Shenliao Bao, Jiyan Jiang, Shiji Zhou, Wenpeng Zhang, Lihong Gu, Jinjie Gu, Guannan Zhang

Model-free RL-based recommender systems have recently received increasing research attention due to their capability to handle partial feedback and long-term rewards.

Recommendation Systems reinforcement-learning

Harnessing the Power of David against Goliath: Exploring Instruction Data Generation without Using Closed-Source Models

no code implementations24 Aug 2023 Yue Wang, Xinrui Wang, Juntao Li, Jinxiong Chang, Qishen Zhang, Zhongyi Liu, Guannan Zhang, Min Zhang

Instruction tuning is instrumental in enabling Large Language Models~(LLMs) to follow user instructions to complete various open-domain tasks.

Who Would be Interested in Services? An Entity Graph Learning System for User Targeting

no code implementations30 May 2023 Dan Yang, Binbin Hu, Xiaoyan Yang, Yue Shen, Zhiqiang Zhang, Jinjie Gu, Guannan Zhang

At the online stage, the system offers the ability of user targeting in real-time based on the entity graph from the offline stage.

graph construction Graph Learning

GARCIA: Powering Representations of Long-tail Query with Multi-granularity Contrastive Learning

no code implementations25 Apr 2023 Weifan Wang, Binbin Hu, Zhicheng Peng, Mingjie Zhong, Zhiqiang Zhang, Zhongyi Liu, Guannan Zhang, Jun Zhou

At last, we conduct extensive experiments on both offline and online environments, which demonstrates the superior capability of GARCIA in improving tail queries and overall performance in service search scenarios.

Contrastive Learning Transfer Learning

TransNet: Transferable Neural Networks for Partial Differential Equations

no code implementations27 Jan 2023 Zezhong Zhang, Feng Bao, Lili Ju, Guannan Zhang

Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs.

Transfer Learning

Model Calibration of the Liquid Mercury Spallation Target using Evolutionary Neural Networks and Sparse Polynomial Expansions

no code implementations18 Feb 2022 Majdi I. Radaideh, Hoang Tran, Lianshan Lin, Hao Jiang, Drew Winder, Sarma Gorti, Guannan Zhang, Justin Mach, Sarah Cousineau

Given that some of the calibrated parameters that show a good agreement with the experimental data can be nonphysical mercury properties, we need a more advanced two-phase flow model to capture bubble dynamics and mercury cavitation.

Level set learning with pseudo-reversible neural networks for nonlinear dimension reduction in function approximation

2 code implementations2 Dec 2021 Yuankai Teng, Zhu Wang, Lili Ju, Anthony Gruber, Guannan Zhang

Our method contains two major components: one is the pseudo-reversible neural network (PRNN) module that effectively transforms high-dimensional input variables to low-dimensional active variables, and the other is the synthesized regression module for approximating function values based on the transformed data in the low-dimensional space.

Dimensionality Reduction regression

PI3NN: Out-of-distribution-aware prediction intervals from three neural networks

1 code implementation ICLR 2022 Siyan Liu, Pei Zhang, Dan Lu, Guannan Zhang

First, existing PI methods require retraining of neural networks (NNs) for every given confidence level and suffer from the crossing issue in calculating multiple PIs.

Prediction Intervals Uncertainty Quantification

A Hybrid Gradient Method to Designing Bayesian Experiments for Implicit Models

no code implementations14 Mar 2021 Jiaxin Zhang, Sirui Bi, Guannan Zhang

However, the approach in Kleinegesse et al., 2020 requires a pathwise sampling path to compute the gradient of the MI lower bound with respect to the design variables, and such a pathwise sampling path is usually inaccessible for implicit models.

Experimental Design

A Scalable Gradient-Free Method for Bayesian Experimental Design with Implicit Models

no code implementations14 Mar 2021 Jiaxin Zhang, Sirui Bi, Guannan Zhang

However, the approach requires a sampling path to compute the pathwise gradient of the MI lower bound with respect to the design variables, and such a pathwise gradient is usually inaccessible for implicit models.

Experimental Design

Scalable Deep-Learning-Accelerated Topology Optimization for Additively Manufactured Materials

no code implementations28 Nov 2020 Sirui Bi, Jiaxin Zhang, Guannan Zhang

Unlike the existing studies of DL for TO, our framework accelerates TO by learning the iterative history data and simultaneously training on the mapping between the given design and its gradient.

AdaDGS: An adaptive black-box optimization method with a nonlocal directional Gaussian smoothing gradient

1 code implementation3 Nov 2020 Hoang Tran, Guannan Zhang

The local gradient points to the direction of the steepest slope in an infinitesimal neighborhood.

Accelerating Reinforcement Learning with a Directional-Gaussian-Smoothing Evolution Strategy

no code implementations21 Feb 2020 Jiaxing Zhang, Hoang Tran, Guannan Zhang

Evolution strategy (ES) has been shown great promise in many challenging reinforcement learning (RL) tasks, rivaling other state-of-the-art deep RL methods.

reinforcement-learning Reinforcement Learning (RL)

A Novel Evolution Strategy with Directional Gaussian Smoothing for Blackbox Optimization

1 code implementation7 Feb 2020 Jiaxin Zhang, Hoang Tran, Dan Lu, Guannan Zhang

Standard ES methods with $d$-dimensional Gaussian smoothing suffer from the curse of dimensionality due to the high variance of Monte Carlo (MC) based gradient estimators.

Robust data-driven approach for predicting the configurational energy of high entropy alloys

no code implementations10 Aug 2019 Jiaxin Zhang, Xianglin Liu, Sirui Bi, Junqi Yin, Guannan Zhang, Markus Eisenbach

In this study, a robust data-driven framework based on Bayesian approaches is proposed and demonstrated on the accurate and efficient prediction of configurational energy of high entropy alloys.

feature selection Small Data Image Classification

Learning nonlinear level sets for dimensionality reduction in function approximation

no code implementations NeurIPS 2019 Guannan Zhang, Jiaxin Zhang, Jacob Hinkle

We developed a Nonlinear Level-set Learning (NLL) method for dimensionality reduction in high-dimensional function approximation with small data.

Functional Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.