Search Results for author:
Found 32 papers, 10 papers with code
Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariance
In this paper, we propose the first unified interpretation for existing zero-shot methods from the perspective of approximating the conditional posterior mean for the reverse diffusion process of conditional sampling.
Mixed Distillation Helps Smaller Language Model Better Reasoning
While large language models (LLMs) have demonstrated exceptional performance in recent natural language processing (NLP) tasks, their deployment poses substantial challenges due to high computational and memory demands in real-world applications.
scBiGNN: Bilevel Graph Representation Learning for Cell Type Classification from Single-cell RNA Sequencing Data
A gene-level GNN is established to adaptively learn gene-gene interactions and cell representations via the self-attention mechanism, and a cell-level GNN builds on the cell-cell graph that is constructed from the cell representations generated by the gene-level GNN.
AiluRus: A Scalable ViT Framework for Dense Prediction
Specifically, at the intermediate layer of the ViT, we utilize a spatial-aware density-based clustering algorithm to select representative tokens from the token sequence.
Frequency-Aware Transformer for Learned Image Compression
Learned image compression (LIC) has gained traction as an effective solution for image storage and transmission in recent years.
AdSEE: Investigating the Impact of Image Style Editing on Advertisement Attractiveness
Online advertisements are important elements in e-commerce sites, social media platforms, and search engines.
OlaGPT: Empowering LLMs With Human-like Problem-Solving Abilities
At present, most approaches focus on chains of thought (COT) and tool use, without considering the adoption and application of human cognitive frameworks.
Learned Lossless Compression for JPEG via Frequency-Domain Prediction
In this paper, we propose a novel framework for learned lossless compression of JPEG images that achieves end-to-end optimized prediction of the distribution of decoded DCT coefficients.
Adapting Shortcut With Normalizing Flow: An Efficient Tuning Framework for Visual Recognition
To mitigate the computational and storage demands, recent research has explored Parameter-Efficient Fine-Tuning (PEFT), which focuses on tuning a minimal number of parameters for efficient adaptation.
Promoting Semantic Connectivity: Dual Nearest Neighbors Contrastive Learning for Unsupervised Domain Generalization
Then, we propose a novel unsupervised domain generalization approach, namely Dual Nearest Neighbors contrastive learning with strong Augmentation (DN^2A).
One for All, All for One: Learning and Transferring User Embeddings for Cross-Domain Recommendation
CAT-ART boosts the recommendation performance in any target domain through the combined use of the learned global user representation and knowledge transferred from other domains, in addition to the original user embedding in the target domain.
Optimization-based Block Coordinate Gradient Coding for Mitigating Partial Stragglers in Distributed Learning
To reduce computational complexity, we first transform each to an equivalent but much simpler discrete problem with N\llL variables representing the partition of the L coordinates into N blocks, each with identical redundancy.
Hierarchical Spherical CNNs with Lifting-based Adaptive Wavelets for Pooling and Unpooling
Specifically, adaptive spherical wavelets are learned with a lifting structure that consists of trainable lifting operators (i. e., update and predict operators).
LiftPool: Lifting-based Graph Pooling for Hierarchical Graph Representation Learning
Subsequently, this local information is aligned and propagated to the preserved nodes to alleviate information loss in graph coarsening.
Hybrid ISTA: Unfolding ISTA With Convergence Guarantees Using Free-Form Deep Neural Networks
This framework is general to endow arbitrary DNNs for solving linear inverse problems with convergence guarantees.
Contrastive Regression for Domain Adaptation on Gaze Estimation
Appearance-based Gaze Estimation leverages deep neural networks to regress the gaze direction from monocular images and achieve impressive performance.
RecGURU: Adversarial Learning of Generalized User Representations for Cross-Domain Recommendation
The learned GUR captures the overall preferences and characteristics of a user and thus can be used to augment the behavior data and improve recommendations in any single domain in which the user is involved.
Graph Convolutional Networks via Adaptive Filter Banks
Graph convolutional networks have been a powerful tool in representation learning of networked data.
Variance Reduced Domain Randomization for Policy Gradient
In this paper, we theoretically derive a bias-free and state/environment-dependent optimal baseline for DR, and analytically show its ability to achieve further variance reduction over the standard constant and state-dependent baselines for DR. We further propose a variance reduced domain randomization (VRDR) approach for policy gradient methods, to strike a tradeoff between the variance reduction and computational complexity in practice.
Graph Neural Networks With Lifting-based Adaptive Graph Wavelets
To ensure that the learned graph representations are invariant to node permutations, a layer is employed at the input of the networks to reorder the nodes according to their local topology information.
Message Passing in Graph Convolution Networks via Adaptive Filter Banks
Furthermore, each filter in the spectral domain corresponds to a message passing scheme, and diverse schemes are implemented via the filter bank.
Similarity Embedding Networks for Robust Human Activity Recognition
Deep learning models for human activity recognition (HAR) based on sensor data have been heavily studied recently.
Meta-HAR: Federated Representation Learning for Human Activity Recognition
However, the effectiveness of federated learning for HAR is affected by the fact that each user has different activity types and even a different signal distribution for the same activity type.
PAC-Bayesian Randomized Value Function with Informative Prior
To address this, in this paper, we propose a Bayesian linear regression with informative prior (IP-BLR) operator to leverage the data-dependent prior in the learning process of randomized value function, which can leverage the statistics of training results from previous iterations.
Learning Latent Architectural Distribution in Differentiable Neural Architecture Search via Variational Information Maximization
Existing differentiable neural architecture search approaches simply assume the architectural distribution on each edge is independent of each other, which conflicts with the intrinsic properties of architecture.
VEM-GCN: Topology Optimization with Variational EM for Graph Convolutional Networks
In the variational E-step, graph topology is optimized by approximating the posterior probability distribution of the latent adjacency matrix with a neural network learned from node embeddings.
Monotonic Robust Policy Optimization with Model Discrepancy
To mitigate the model discrepancy between training and target (testing) environments, domain randomization (DR) can generate plenty of environments with a sufficient diversity by randomly sampling environment parameters in simulator.
NCGNN: Node-Level Capsule Graph Neural Network for Semisupervised Classification
Therefore, it can relieve the over-smoothing issue and learn effective node representations over graphs with homophily or heterophily.
MimicNorm: Weight Mean and Last BN Layer Mimic the Dynamic of Batch Normalization
We leverage the neural tangent kernel (NTK) theory to prove that our weight mean operation whitens activations and transits network into the chaotic regime like BN layer, and consequently, leads to an enhanced convergence.
Graph Pooling with Node Proximity for Hierarchical Representation Learning
In this paper, we propose a novel graph pooling strategy that leverages node proximity to improve the hierarchical representation learning of graph data with their multi-hop topology.
Android Malware Detection using Large-scale Network Representation Learning
With the growth of mobile devices and applications, the number of malicious software, or malware, is rapidly increasing in recent years, which calls for the development of advanced and effective malware detection approaches.
Cryptography and Security
Android Malware Detection based on Factorization Machine
As the popularity of Android smart phones has increased in recent years, so too has the number of malicious applications.
Cryptography and Security
