All projects
What did they actually mean?
Reddit Advice Intent Classifier
People give advice, warnings, sympathy and stories in nearly identical language. This benchmarks four NLP architectures on telling those five intents apart — I owned the BiLSTM.
Source 0.506macro F1, beat BERT-base
People give advice, warnings, sympathy and stories in nearly identical language. This benchmarks four NLP architectures on telling those five intents apart — I owned the BiLSTM.
Owned the BiLSTM. Frozen Flair contextual embeddings, concat-pooling, class-weighted loss.
Built the dataset by hand. 2,000 comments scraped from four subreddits, annotated under a label-priority protocol.
Measurably consistent labels. Cohen's Kappa of 0.534 across double-annotated instances.
Top 4 on the leaderboard. Out-scored a BERT-base baseline on the held-out test set.