Browse > Natural Language Processing > Chinese > Chinese Word Segmentation

Chinese Word Segmentation

21 papers with code · Natural Language Processing
Subtask of Chinese

Leaderboards

Greatest papers with code

PKUSEG: A Toolkit for Multi-Domain Chinese Word Segmentation

27 Jun 2019lancopku/pkuseg-python

Chinese word segmentation (CWS) is a fundamental step of Chinese natural language processing.

CHINESE WORD SEGMENTATION

ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations

2 Nov 2019sinovation/ZEN

Moreover, it is shown that reasonable performance can be obtained when ZEN is trained on a small corpus, which is important for applying pre-training techniques to scenarios with limited data.

CHINESE NAMED ENTITY RECOGNITION CHINESE WORD SEGMENTATION DOCUMENT CLASSIFICATION NATURAL LANGUAGE INFERENCE PART-OF-SPEECH TAGGING SENTENCE PAIR MODELING SENTIMENT ANALYSIS

Effective Neural Solution for Multi-Criteria Word Segmentation

7 Dec 2017hankcs/multi-criteria-cws

We present a simple yet elegant solution to train a single joint model on multi-criteria corpora for Chinese Word Segmentation (CWS).

CHINESE WORD SEGMENTATION

Fast and Accurate Neural Word Segmentation for Chinese

ACL 2017 jcyk/greedyCWS

Neural models with minimal feature engineering have achieved competitive performance against traditional methods for the task of Chinese word segmentation.

CHINESE WORD SEGMENTATION FEATURE ENGINEERING

Neural Word Segmentation Learning for Chinese

ACL 2016 jcyk/CWS

Most previous approaches to Chinese word segmentation formalize this problem as a character-based sequence labeling task where only contextual information within fixed sized local windows and simple interactions between adjacent tags can be captured.

CHINESE WORD SEGMENTATION FEATURE ENGINEERING

Subword Encoding in Lattice LSTM for Chinese Word Segmentation

NAACL 2019 jiesutd/SubwordEncoding-CWS

Previous lattice LSTM model takes word embeddings as the lexicon input, we prove that subword encoding can give the comparable performance and has the benefit of not relying on any external segmentor.

CHINESE WORD SEGMENTATION WORD EMBEDDINGS

Simplifying Neural Machine Translation with Addition-Subtraction Twin-Gated Recurrent Networks

EMNLP 2018 bzhangGo/zero

Experiments on WMT14 translation tasks demonstrate that ATR-based neural machine translation can yield competitive performance on English- German and English-French language pairs in terms of both translation quality and speed.

CHINESE WORD SEGMENTATION MACHINE TRANSLATION NATURAL LANGUAGE INFERENCE

Unsupervised Neural Word Segmentation for Chinese via Segmental Language Modeling

EMNLP 2018 Edward-Sun/SLM

As far as we know, we are the first to propose a neural model for unsupervised CWS and achieve competitive performance to the state-of-the-art statistical models on four different datasets from SIGHAN 2005 bakeoff.

CHINESE WORD SEGMENTATION LANGUAGE MODELLING