Skip to content

Files

Latest commit

Dec 21, 2017
1c8f5b3 · Dec 21, 2017

History

History
This branch is 9 commits behind bfelbo/DeepMoji:master.

examples

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Sep 6, 2017
Oct 6, 2017
Sep 6, 2017
Sep 6, 2017
Dec 21, 2017
Dec 21, 2017
Sep 6, 2017
Dec 21, 2017
Dec 21, 2017
Dec 21, 2017
Oct 12, 2017
Dec 21, 2017
Dec 21, 2017
Sep 6, 2017

DeepMoji examples

Initialization

create_twitter_vocab.py
Create a new vocabulary from a tsv file.

tokenize_dataset.py
Tokenize a given dataset using the prebuilt vocabulary.

vocab_extension.py
Extend the given vocabulary using dataset-specific words.

dataset_split.py
Split a given dataset into training, validation and testing.

Use pretrained model/architecture

score_texts_emojis.py
Use DeepMoji to score texts for emoji distribution.

encode_texts.py
Use DeepMoji to encode the text into 2304-dimensional feature vectors for further modeling/analysis.

imdb_from_scratch.py Train the DeepMoji on the IMDB sentiment classification task without loading the pretrained weights.

Transfer learning

finetune_youtube_last.py
Finetune the model on the SS-Youtube dataset using the 'last' method.

finetune_insults_chain-thaw.py
Finetune the model on the Kaggle insults dataset (from blog post) using the 'chain-thaw' method.

finetune_semeval_class-avg_f1.py
Finetune the model on the SemeEval emotion dataset using the 'full' method and evaluate using the class average F1 metric.