Search Results for author:
Found 10 papers, 6 papers with code
Integrated multi-operand optical neurons for scalable and hardware-efficient deep learning
The optical neural network (ONN) is a promising hardware platform for next-generation neuromorphic computing due to its high parallelism, low latency, and low energy consumption.
M3ICRO: Machine Learning-Enabled Compact Photonic Tensor Core based on PRogrammable Multi-Operand Multimode Interference
The programmable MOMMI leverages the intrinsic light propagation principle, providing a single-device programmable matrix unit beyond the conventional computing paradigm of one multiply-accumulate (MAC) operation per device.
Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformers
Experiments demonstrate that we can reduce the training and inference time of Pre-LN Transformers by 1% - 10%.
NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulation
In this work, for the first time, a physics-agnostic neural operator-based framework, dubbed NeurOLight, is proposed to learn a family of frequency-domain Maxwell PDEs for ultra-fast parametric photonic device simulation.
Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Search
On the other hand, the capability of making high-CTR retrieval is optimized by learning to discriminate user's clicked ads from the entire corpus.
ELight: Enabling Efficient Photonic In-Memory Neurocomputing with Life Enhancement
With the recent advances in optical phase change material (PCM), photonic in-memory neurocomputing has demonstrated its superiority in optical neural network (ONN) designs with near-zero static power consumption, time-of-light latency, and compact footprint.
A compact butterfly-style silicon photonic-electronic neural chip for hardware-efficient deep learning
The optical neural network (ONN) is a promising hardware platform for next-generation neurocomputing due to its high parallelism, low latency, and low energy consumption.
L2ight: Enabling On-Chip Learning for Optical Neural Networks via Efficient in-situ Subspace Optimization
In this work, we propose a closed-loop ONN on-chip learning framework L2ight to enable scalable ONN mapping and efficient in-situ learning.
Towards Memory-Efficient Neural Networks via Multi-Level in situ Generation
Deep neural networks (DNN) have shown superior performance in a variety of tasks.
A Rule-Based Computational Model of Cognitive Arithmetic
This area of research explores the retrieval mechanisms and strategies used by people during a common cognitive task.
