Softplus

Softplus is an activation function $f\left(x\right) = \log\left(1+\exp\left(x\right)\right)$. It can be viewed as a smooth version of ReLU.

Latest Papers

PAPER DATE
Comparisons among different stochastic selection of activation layers for convolutional neural networks for healthcare
Loris NanniAlessandra LuminiStefano GhidoniGianluca Maguolo
2020-11-24
Scaled-YOLOv4: Scaling Cross Stage Partial Network
| Chien-Yao WangAlexey BochkovskiyHong-Yuan Mark Liao
2020-11-16
Real-Time Polyp Detection, Localisation and Segmentation in Colonoscopy Using Deep Learning
Debesh JhaSharib AliHåvard D. JohansenDag D. JohansenJens RittscherMichael A. RieglerPål Halvorsen
2020-11-15
Real-time object detection method based on improved YOLOv4-tiny
Zicong JiangLiquan ZhaoShuaiyang LiYanfei Jia
2020-11-09
Universal Activation Function For Machine Learning
Brosnan YuenMinh Tu HoangXiaodai DongTao Lu
2020-11-07
On the Universality of the Double Descent Peak in Ridgeless Regression
David Holzmüller
2020-10-05
Detecting soccer balls with reduced neural networks: a comparison of multiple architectures under constrained hardware scenarios
Douglas De Rizzo MeneghettiThiago Pedro Donadon HomemJonas Henrique Renolfi de OliveiraIsaac Jesus da SilvaDanilo Hernani PericoReinaldo Augusto da Costa Bianchi
2020-09-28
EIS -- a family of activation functions combining Exponential, ISRU, and Softplus
Koushik BiswasSandeep KumarShilpak BanerjeeAshish Kumar Pandey
2020-09-28
YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
Yuxuan CaiHongjia LiGeng YuanWei NiuYanyu LiXulong TangBin RenYanzhi Wang
2020-09-12
Deep Volumetric Ambient Occlusion
| Dominik EngelTimo Ropinski
2020-08-19
A Deep Convolutional Neural Network for the Detection of Polyps in Colonoscopy Images
Tariq RahimSyed Ali HassanSoo Young Shin
2020-08-15
Object Detection and Tracking Algorithms for Vehicle Counting: A Comparative Analysis
Vishal MandalYaw Adu-Gyamfi
2020-07-31
PP-YOLO: An Effective and Efficient Implementation of Object Detector
| Xiang LongKaipeng DengGuanzhong WangYang ZhangQingqing DangYuan GaoHui ShenJianguo RenShumin HanErrui DingShilei Wen
2020-07-23
Big GANs Are Watching You: Towards Unsupervised Object Segmentation with Off-the-Shelf Generative Models
| Andrey VoynovStanislav MorozovArtem Babenko
2020-06-08
YOLOv4: Optimal Speed and Accuracy of Object Detection
| Alexey BochkovskiyChien-Yao WangHong-Yuan Mark Liao
2020-04-23
U-Det: A Modified U-Net architecture with bidirectional feature network for lung nodule segmentation
Nikhil Varma KeethaSamson Anosh Babu PChandra Sekhara Rao Annavarapu
2020-03-20
Reconstructing Natural Scenes from fMRI Patterns using BigBiGAN
Milad MozafariLeila ReddyRufin VanRullen
2020-01-31
CSPNet: A New Backbone that can Enhance Learning Capability of CNN
| Chien-Yao WangHong-Yuan Mark LiaoI-Hau YehYueh-Hua WuPing-Yang ChenJun-Wei Hsieh
2019-11-27
Tight Sample Complexity of Learning One-hidden-layer Convolutional Neural Networks
Yuan CaoQuanquan Gu
2019-11-12
Approximation capabilities of neural networks on unbounded domains
Ming-Xi WangYang Qu
2019-10-21
Subsampling Generative Adversarial Networks: Density Ratio Estimation in Feature Space with Softplus Loss
| Xin DingZ. Jane WangWilliam J. Welch
2019-09-24
Mish: A Self Regularized Non-Monotonic Neural Activation Function
| Diganta Misra
2019-08-23
Large Scale Adversarial Representation Learning
| Jeff DonahueKaren Simonyan
2019-07-04
Learning the optimal state-feedback via supervised imitation learning
Dharmesh TailorDario Izzo
2019-01-07
Semantic WordRank: Generating Finer Single-Document Summarizations
Hao ZhangJie Wang
2018-09-12
Uncertainty Estimations by Softplus normalization in Bayesian Convolutional Neural Networks with Variational Inference
| Kumar ShridharFelix LaumannMarcus Liwicki
2018-06-15
Efficient and Effective Single-Document Summarizations and A Word-Embedding Measurement of Quality
Liqun ShaoHao ZhangMing JiaJie Wang
2017-10-01
Noisy Softplus: an activation function that enables SNNs to be trained as ANNs
Qian LiuYunhua ChenSteve Furber
2017-03-31
Permuted and Augmented Stick-Breaking Bayesian Multinomial Regression
Quan ZhangMingyuan Zhou
2016-12-30
Softplus Regressions and Convex Polytopes
Mingyuan Zhou
2016-08-23

Components

COMPONENT TYPE
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories