Ignore Me But Don't Replace Me: Utilizing Non-Linguistic Elements for Pretraining on the Cybersecurity Domain

no code implementations • 15 Mar 2024 • Eugene Jang, Jian Cui, Dayeon Yim, Youngjin Jin, Jin-Woo Chung, Seungwon Shin, YongJae lee

We use our domain-customized methodology to train CyBERTuned, a cybersecurity domain language model that outperforms other cybersecurity PLMs on most tasks.

Language Modelling token-classification +1

DarkBERT: A Language Model for the Dark Side of the Internet

no code implementations • 15 May 2023 • Youngjin Jin, Eugene Jang, Jian Cui, Jin-Woo Chung, YongJae lee, Seungwon Shin

Recent research has suggested that there are clear differences in the language used in the Dark Web compared to that of the Surface Web.

Language Modelling

A Deep Dive into NFT Whales: A Longitudinal Study of the NFT Trading Ecosystem

no code implementations • 2 Feb 2023 • Na Hyeon Park, Hanna Kim, Chanhee Lee, Changhoon Yoon, Seunghyeon Lee, Youngjin Jin, Seungwon Shin

NFT (Non-fungible Token) has drastically increased in its size, accounting for over \$16. 9B of total market capitalization.

Shedding New Light on the Language of the Dark Web

no code implementations • NAACL 2022 • Youngjin Jin, Eugene Jang, YongJae lee, Seungwon Shin, Jin-Woo Chung

By leveraging CoDA, we conduct a thorough linguistic analysis of the Dark Web and examine the textual differences between the Dark Web and the Surface Web.

text-classification Text Classification