Search Results for author: Shubhra Kanti Karmaker Santu

Found 17 papers, 2 papers with code

Prompting LLMs to Compose Meta-Review Drafts from Peer-Review Narratives of Scholarly Manuscripts

no code implementations23 Feb 2024 Shubhra Kanti Karmaker Santu, Sanjeev Kumar Sinha, Naman Bansal, Alex Knipper, Souvika Sarkar, John Salvador, Yash Mahajan, Sri Guttikonda, Mousumi Akter, Matthew Freestone, Matthew C. Williams Jr

One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves understanding the core contributions, strengths, and weaknesses of a scholarly manuscript based on peer-review narratives from multiple experts and then summarizing those multiple experts' perspectives into a concise holistic overview.

SNNLP: Energy-Efficient Natural Language Processing Using Spiking Neural Networks

1 code implementation31 Jan 2024 R. Alexander Knipper, Kaniz Mishty, Mehdi Sadi, Shubhra Kanti Karmaker Santu

As spiking neural networks receive more attention, we look toward applications of this computing paradigm in fields other than computer vision and signal processing.

Sentiment Analysis

FaNS: a Facet-based Narrative Similarity Metric

no code implementations9 Sep 2023 Mousumi Akter, Shubhra Kanti Karmaker Santu

Similar Narrative Retrieval is a crucial task since narratives are essential for explaining and understanding events, and multiple related narratives often help to create a holistic view of the event of interest.

Retrieval text similarity

Redundancy Aware Multi-Reference Based Gainwise Evaluation of Extractive Summarization

no code implementations4 Aug 2023 Mousumi Akter, Shubhra Kanti Karmaker Santu

While very popular for evaluating extractive summarization task, the ROUGE metric has long been criticized for its lack of semantic awareness and its ignorance about the ranking quality of the summarizer.

Extractive Summarization

ChatGPT as your Personal Data Scientist

no code implementations23 May 2023 Md Mahadi Hassan, Alex Knipper, Shubhra Kanti Karmaker Santu

Instead, envision an intelligent agent capable of assisting users in conducting AutoML tasks through intuitive, natural conversations without requiring in-depth knowledge of the underlying machine learning (ML) processes.

AutoML Data Visualization

TELeR: A General Taxonomy of LLM Prompts for Benchmarking Complex Tasks

no code implementations19 May 2023 Shubhra Kanti Karmaker Santu, Dongji Feng

However, conducting such benchmarking studies is challenging because of the large variations in LLMs' performance when different prompt types/styles are used and different degrees of detail are provided in the prompts.

Benchmarking

Processing Natural Language on Embedded Devices: How Well Do Transformer Models Perform?

2 code implementations23 Apr 2023 Souvika Sarkar, Mohammad Fakhruddin Babar, Md Mahadi Hassan, Monowar Hasan, Shubhra Kanti Karmaker Santu

This paper presents a performance study of transformer language models under different hardware configurations and accuracy requirements and derives empirical observations about these resource/accuracy trade-offs.

Sentiment Analysis Sentiment Classification

Zero-Shot Multi-Label Topic Inference with Sentence Encoders

no code implementations14 Apr 2023 Souvika Sarkar, Dongji Feng, Shubhra Kanti Karmaker Santu

Sentence encoders have indeed been shown to achieve superior performances for many downstream text-mining tasks and, thus, claimed to be fairly general.

Sentence

Joint Upper & Lower Bound Normalization for IR Evaluation

no code implementations12 Sep 2022 Shubhra Kanti Karmaker Santu, Dongji Feng

Experiments on two different data-sets with eight Learning-to-Rank (LETOR) methods demonstrate the following properties of the new LB normalized metric: 1) Statistically significant differences (between two methods) in terms of original metric no longer remain statistically significant in terms of Upper Lower (UL) Bound normalized version and vice-versa, especially for uninformative query-sets.

Learning-To-Rank

Multi-Narrative Semantic Overlap Task: Evaluation and Benchmark

no code implementations14 Jan 2022 Naman Bansal, Mousumi Akter, Shubhra Kanti Karmaker Santu

In this paper, we introduce an important yet relatively unexplored NLP task called Multi-Narrative Semantic Overlap (MNSO), which entails generating a Semantic Overlap of multiple alternate narratives.

Sentence Text Summarization

AutoML to Date and Beyond: Challenges and Opportunities

no code implementations21 Oct 2020 Shubhra Kanti Karmaker Santu, Md. Mahadi Hassan, Micah J. Smith, Lei Xu, ChengXiang Zhai, Kalyan Veeramachaneni

AutoML tools aim to make machine learning accessible for non-machine learning experts (domain experts), to improve the efficiency of machine learning, and to accelerate machine learning research.

AutoML BIG-bench Machine Learning

TILM: Neural Language Models with Evolving Topical Influence

no code implementations CONLL 2019 Shubhra Kanti Karmaker Santu, Kalyan Veeramachaneni, ChengXiang Zhai

Specifically, we propose a novel language model called Topical Influence Language Model (TILM), which is a novel extension of a neural language model to capture the influences on the contents in one text stream by the evolving topics in another related (or possibly same) text stream.

Language Modelling

JIM: Joint Influence Modeling for Collective Search Behavior

no code implementations1 Mar 2019 Shubhra Kanti Karmaker Santu, Liangda Li, Yi Chang, ChengXiang Zhai

This assumption is unrealistic as there are many correlated events in the real world which influence each other and thus, would pose a joint influence on the user search behavior rather than posing influence independently.

On Application of Learning to Rank for E-Commerce Search

no code implementations1 Mar 2019 Shubhra Kanti Karmaker Santu, Parikshit Sondhi, ChengXiang Zhai

In this paper, we discuss the practical challenges in applying learning to rank methods to E-Com search, including the challenges in feature representation, obtaining reliable relevance judgments, and optimally exploiting multiple user feedback signals such as click rates, add-to-cart ratios, order rates, and revenue.

Attribute Information Retrieval +2

Cannot find the paper you are looking for? You can Submit a new open access paper.