Nemotron-4 15B Technical Report

no code implementations • 26 Feb 2024 • Jupinder Parmar, Shrimai Prabhumoye, Joseph Jennings, Mostofa Patwary, Sandeep Subramanian, Dan Su, Chen Zhu, Deepak Narayanan, Aastha Jhunjhunwala, Ayush Dattagupta, Vibhu Jawa, Jiwei Liu, Ameya Mahabaleshwarkar, Osvald Nitski, Annika Brundyn, James Maki, Miguel Martinez, Jiaxuan You, John Kamalu, Patrick Legresley, Denys Fridman, Jared Casper, Ashwath Aithal, Oleksii Kuchaiev, Mohammad Shoeybi, Jonathan Cohen, Bryan Catanzaro

We introduce Nemotron-4 15B, a 15-billion-parameter large multilingual language model trained on 8 trillion text tokens.

Language Modelling

Heterogenous Ensemble of Models for Molecular Property Prediction

1 code implementation • 20 Nov 2022 • Sajad Darabi, Shayan Fazeli, Jiwei Liu, Alexandre Milesi, Pawel Morkisz, Jean-François Puget, Gilberto Titericz

Previous works have demonstrated the importance of considering different modalities on molecules, each of which provide a varied granularity of information for downstream property prediction tasks.

Molecular Property Prediction Property Prediction +1

GPU Accelerated Exhaustive Search for Optimal Ensemble of Black-Box Optimization Algorithms

1 code implementation • 8 Dec 2020 • Jiwei Liu, Bojan Tunguz, Gilberto Titericz

We propose a Multi-GPU-optimized framework to accelerate a brute force search for the optimal ensemble of black-box optimization algorithms by running many experiments in parallel.

A Locating Model for Pulmonary Tuberculosis Diagnosis in Radiographs

no code implementations • 22 Oct 2019 • Jiwei Liu, Junyu Liu, Yang Liu, Rui Yang, Dongjun Lv, Zhengting Cai, Jingjing Cui

Significance: We first make full use of the feature extraction ability of CNNs in TB diagnostic field and make exploration in localization of TB, when the previous works focus on the weaker task of healthy-sick subject classification.

Position regression