Search Results for author: Ivan P. Yamshchikov

Found 27 papers, 6 papers with code

Knowledge Graph Representation for Political Information Sources

no code implementations4 Apr 2024 Tinatin Osmonova, Alexey Tikhonov, Ivan P. Yamshchikov

With the rise of computational social science, many scholars utilize data analysis and natural language processing tools to analyze social media, news articles, and other accessible data sources for examining political and social discourse.

Knowledge Graphs

Echo-chambers and Idea Labs: Communication Styles on Twitter

no code implementations28 Mar 2024 Aleksandra Sorokovikova, Michael Becker, Ivan P. Yamshchikov

This paper investigates the communication styles and structures of Twitter (X) communities within the vaccination context.

Vygotsky Distance: Measure for Benchmark Task Similarity

no code implementations22 Feb 2024 Maxim K. Surkov, Ivan P. Yamshchikov

The core idea of this similarity measure is that it is based on relative performance of the "students" on a given task, rather that on the properties of the task itself.

LLMs Simulate Big Five Personality Traits: Further Evidence

no code implementations31 Jan 2024 Aleksandra Sorokovikova, Natalia Fedorova, Sharwin Rezagholi, Ivan P. Yamshchikov

An empirical investigation into the simulation of the Big Five personality traits by large language models (LLMs), namely Llama2, GPT4, and Mixtral, is presented.

Neural Machine Translation for Malayalam Paraphrase Generation

no code implementations31 Jan 2024 Christeena Varghese, Sergey Koshelev, Ivan P. Yamshchikov

This study explores four methods of generating paraphrases in Malayalam, utilizing resources available for English paraphrasing and pre-trained Neural Machine Translation (NMT) models.

Machine Translation NMT +2

Post Turing: Mapping the landscape of LLM Evaluation

no code implementations3 Nov 2023 Alexey Tikhonov, Ivan P. Yamshchikov

In the rapidly evolving landscape of Large Language Models (LLMs), introduction of well-defined and standardized evaluation methodologies remains a crucial challenge.

Fairness

Rehabilitating Homeless: Dataset and Key Insights

1 code implementation9 Feb 2023 Anna Bykova, Nikolay Filippov, Ivan P. Yamshchikov

This paper presents a large anonymized dataset of homelessness alongside insights into the data-driven rehabilitation of homeless people.

Pragmatic Constraint on Distributional Semantics

no code implementations20 Nov 2022 Elizaveta Zhemchuzhina, Nikolai Filippov, Ivan P. Yamshchikov

This paper studies the limits of language models' statistical learning in the context of Zipf's law.

BERT in Plutarch's Shadows

no code implementations10 Nov 2022 Ivan P. Yamshchikov, Alexey Tikhonov, Yorgos Pantis, Charlotte Schubert, Jürgen Jost

In particular, the Placita Philosophorum, together with one of the other Pseudo-Plutarch texts, shows similarities with the texts written by authors from an Alexandrian context (2nd/3rd century CE).

Language Modelling Philosophy

What is Wrong with Language Models that Can Not Tell a Story?

no code implementations9 Nov 2022 Ivan P. Yamshchikov, Alexey Tikhonov

This paper argues that a deeper understanding of narrative and the successful generation of longer subjectively interesting texts is a vital bottleneck that hinders the progress in modern Natural Language Processing (NLP) and may even be in the whole field of Artificial Intelligence.

Vocabulary Transfer for Medical Texts

no code implementations4 Aug 2022 Vladislav D. Mosin, Ivan P. Yamshchikov

Vocabulary transfer is a transfer learning subtask in which language models fine-tune with the corpus-specific tokenization instead of the default one, which is being used during pretraining.

Transfer Learning

Fine-Tuning Transformers: Vocabulary Transfer

1 code implementation29 Dec 2021 Vladislav Mosin, Igor Samenko, Alexey Tikhonov, Borislav Kozlovskii, Ivan P. Yamshchikov

Transformers are responsible for the vast majority of recent advances in natural language processing.

Transfer Learning

Do Data-based Curricula Work?

no code implementations13 Dec 2021 Maxim K. Surkov, Vladislav D. Mosin, Ivan P. Yamshchikov

Current state-of-the-art NLP systems use large neural networks that require lots of computational resources for training.

Actionable Entities Recognition Benchmark for Interactive Fiction

1 code implementation28 Sep 2021 Alexey Tikhonov, Ivan P. Yamshchikov

This paper presents a new natural language processing task - Actionable Entities Recognition (AER) - recognition of entities that protagonists could interact with for further plot development.

named-entity-recognition Named Entity Recognition +1

DYPLODOC: Dynamic Plots for Document Classification

no code implementations26 Jul 2021 Anastasia Malysheva, Alexey Tikhonov, Ivan P. Yamshchikov

Narrative generation and analysis are still on the fringe of modern natural language processing yet are crucial in a variety of applications.

Classification Document Classification

Paranoid Transformer: Reading Narrative of Madness as Computational Approach to Creativity

1 code implementation13 Jul 2020 Yana Agafonova, Alexey Tikhonov, Ivan P. Yamshchikov

We describe technical details of the generative system, provide examples of output and discuss the impact of receptive theory, chance discovery and simulation of fringe mental state on the understanding of computational creativity.

Text Generation

Artificial Neural Networks Jamming on the Beat

no code implementations13 Jul 2020 Alexey Tikhonov, Ivan P. Yamshchikov

It suggests a very simple workaround for this challenge, namely, generation of a drum pattern that could be further used as a foundation for melody generation.

Intuitive Contrasting Map for Antonym Embeddings

1 code implementation27 Apr 2020 Igor Samenko, Alexey Tikhonov, Ivan P. Yamshchikov

This paper shows that, modern word embeddings contain information that distinguishes synonyms and antonyms despite small cosine similarities between corresponding vectors.

Word Embeddings

Style-transfer and Paraphrase: Looking for a Sensible Semantic Similarity Metric

no code implementations10 Apr 2020 Ivan P. Yamshchikov, Viacheslav Shibaev, Nikolay Khlebnikov, Alexey Tikhonov

The rapid development of such natural language processing tasks as style transfer, paraphrase, and machine translation often calls for the use of semantic similarity metrics.

Machine Translation Semantic Similarity +4

It Means More if It Sounds Good: Yet Another Hypothesis Concerning the Evolution of Polysemous Words

no code implementations12 Mar 2020 Ivan P. Yamshchikov, Cyrille Merleau Nono Saha, Igor Samenko, Jürgen Jost

This position paper looks into the formation of language and shows ties between structural properties of the words in the English language and their polysemy.

Position

Decomposing Textual Information For Style Transfer

no code implementations WS 2019 Ivan P. Yamshchikov, Viacheslav Shibaev, Aleksander Nagaev, Jürgen Jost, Alexey Tikhonov

This paper focuses on latent representations that could effectively decompose different aspects of textual information.

Style Transfer

Style Transfer for Texts: Retrain, Report Errors, Compare with Rewrites

1 code implementation IJCNLP 2019 Alexey Tikhonov, Viacheslav Shibaev, Aleksander Nagaev, Aigul Nugmanova, Ivan P. Yamshchikov

Second, starting with certain values of bilingual evaluation understudy (BLEU) between input and output and accuracy of the sentiment transfer the optimization of these two standard metrics diverge from the intuitive goal of the style transfer task.

Style Transfer Text Style Transfer

What is wrong with style transfer for texts?

no code implementations13 Aug 2018 Alexey Tikhonov, Ivan P. Yamshchikov

A number of recent machine learning papers work with an automated style transfer for texts and, counter to intuition, demonstrate that there is no consensus formulation of this NLP task.

BIG-bench Machine Learning Style Transfer

Cannot find the paper you are looking for? You can Submit a new open access paper.