Best Demo Award at ACL2021
Congratulations to the recipients of the Best Demo Award at ACL 2021!
Best Demo Award
EXPLAINABOARD: An Explainable Leaderboard for NLP
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaichen Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye and Graham Neubig
This very useful demo allows the user to compare state of the art papers (or your own output) from both a theoretical (explanatory) perspective AND actual output perspecitves, as shown in as many as 6 tasks (they claim they implemented 74 NER systems) on 3 dimensions: Interpretability (single-system analysis, pair-wise analysis, data bias analysis), Interactivity (Fine-graine error analysis, system combination), and reliability (Confidence and calibration). It is really a good tool to use on your own systems as you tune them!.
Best Demo Runner-up
ESRA: Explainable Scientific Research Assistant
Pollawat Hongwimol, Peeranuth Kehasukcharoen, Pasit Laohawarutchai, Piyawat Lertvittayakumjorn, Aik Beng Ng, Zhangsheng Lai, Timothy Liu and Peerapon Vateekul
The demo provides interesting insights into a body of research articles, by ingesting a large amount of them. It allows the user to search for keyphrases and displays in return a graph with nodes representing papers, research topics, authors, affiliations, tasks, metrics, etc, and relations among them. This allows the user to explore the research space in interesting ways, for instance navigating from BERT to Transformers to RoBERTa, LongFormer.
Best Demo Award Committee
- Radu Florian (IBM Research, Chair)
- Elizabeth Boschee (ISI)
- Ying Lin (Apple)
- Nazneen Rajani (Salesforce)
- Han Wang (Amazon Alexa AI)
- Diyi Yang (Georgia Tech)
We’d like to express great thanks to the Best Demo Paper Award committee for all of their time and efforts at reviewing the papers, their reviews and pre-recorded demo videos, extensive discussions and justifications for selecting the award.
Heng Ji, Jong C. Park and Rui Xia (ACL2021 Demo Co-Chairs)
ACL-IJCNLP Demo Track 2021
Accepted Submissions
A Graphical Interface for Curating Schemas
Piyush Mishra, Akanksha Malhotra, Susan Windisch Brown, Martha Palmer and Ghazaleh Kazeminejad
ChrEnTranslate: Cherokee-English Machine Translation Demo with Quality Estimation and Corrective Feedback
Shiyue Zhang, Benjamin Frey and Mohit Bansal
CLTR: An End-to-End, Transformer-Based System for Cell-Level Table Retrieval and Table Question Answering
Feifei Pan, Mustafa Canim, Michael Glass, Alfio Gliozzo and Peter Fox
CogIE: An Information Extraction Toolkit for Bridging Texts and CogNet
Zhuoran Jin, Yubo Chen, Dianbo Sui, Chenhao Wang, Zhipeng Xue and Jun Zhao
CRSLab: An Open-Source Toolkit for Building Conversational Recommender System
Kun Zhou, Xiaolei Wang, Yuanhang Zhou, Chenzhan Shang, Yuan Cheng, Wayne Xin Zhao, Yaliang Li and Ji-Rong Wen
Dodrio: Exploring Transformer Models with Interactive Visualization
Zijie J. Wang, Robert Turko and Duen Horng Chau
Does My Representation Capture X? Probe-Ably
Deborah Ferreira, Julia Rozanova, Mokanarangan Thayaparan, Marco Valentino and André Freitas
Ecco: An Open Source Library for the Explainability of Transformer Language Models
J Alammar
Erase and Rewind: Manual Correction of NLP Output through a Web Interface
Valentino Frasnelli, Lorenzo Bocchi and Alessio Palmero Aprosio
ExplainaBoard: An Explainable Leaderboard for NLP
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaichen Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye and Graham Neubig
Exploring Word Usage Change with Continuously Evolving Embeddings
Franziska Horn
fastHan: A BERT-based Multi-Task Toolkit for Chinese NLP
Zhichao Geng, Hang Yan, Xipeng Qiu and Xuanjing Huang
FastSeq: Make Sequence Generation Faster
Yu Yan, Fei Hu, Jiusheng Chen, Nikhil Bhendawade, Ting Ye, Yeyun Gong, Nan Duan, Desheng Cui, Bingyu Chi and Ruofei Zhang
IFlyEA: A Chinese Essay Assessment System with Automated Rating, Review Generation, and Recommendation
Jiefu Gong, Xiao Hu, Wei Song, Ruiji Fu, Zhichao Sheng, Bo Zhu, Shijin Wang and Ting Liu
Inside ASCENT: Exploring a Deep Commonsense Knowledge Base and its Usage in Question Answering
Tuan-Phong Nguyen, Simon Razniewski and Gerhard Weikum
IntelliCAT: Intelligent Machine Translation Post-Editing with Quality Estimation and Translation Suggestion
Dongjun Lee, Junhyeong Ahn, Heesoo Park and Jaemin Jo
KuiLeiXi: a Chinese Open-Ended Text Adventure Game
Yadong Xi, Xiaoxi Mao, Le Li, Lei Lin, Yanjiang Chen, Shuhan Yang, Xuhan Chen, Kailun Tao, Zhi Li, Gongzheng Li, Lin Jiang, Siyan Liu, Zeng Zhao, Minlie Huang, Changjie Fan and Zhipeng Hu
LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing
Yu Li, Josh Arnold, Feifan Yan, Weiyan Shi and Zhou Yu
LOA: Logical Optimal Actions for Text-based Interaction Games
Daiki Kimura, Subhajit Chaudhury, Masaki Ono, Michiaki Tatsubori, Don Joven Agravante, Asim Munawar, Akifumi Wachi, Ryosuke Kohita and Alexander Gray
Many-to-English Machine Translation Tools, Data, and Pretrained Models
Thamme Gowda, Zhao Zhang, Chris Mattmann and Jonathan May
Neural Extractive Search
Shauli Ravfogel, Hillel Taub-Tabib and Yoav Goldberg
NeurST: Neural Speech Translation Toolkit
Chengqi Zhao, Mingxuan Wang, Qianqian Dong, Rong Ye and Lei Li
OpenAttack: An Open-source Textual Adversarial Attack Toolkit
Guoyang Zeng, Fanchao Qi, Qianrui Zhou, Tingji Zhang, Zixian Ma, Bairu Hou, Yuan Zang, Zhiyuan Liu and Maosong Sun
ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpus
Ayyoob ImaniGooghari, Masoud Jalili Sabet, Philipp Dufter, Michael Cysou and Hinrich Schütze
PAWLS: PDF Annotation With Labels and Structure
Mark Neumann, Zejiang Shen and Sam Skjonsberg
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation
Weizhen Qi, Yeyun Gong, Yu Yan, Can Xu, Bolun Yao, Bartuer Zhou, Biao Cheng, Daxin Jiang, Jiusheng Chen, Ruofei Zhang, Houqiang Li and Nan Duan
REM: Efficient Semi-Automated Real-Time Moderation of Online Forums
Jakob Smedegaard Andersen, Olaf Zukunft and Walid Maalej
ReTraCk: A Flexible and Efficient Framework for Knowledge Base Question Answering
Shuang Chen, Qian Liu, Zhiwei Yu, Chin-Yew Lin, Jian-Guang Lou and Feng Jiang
SciConceptMiner: A system for large-scale scientific concept discovery
Zhihong Shen, Chieh-Han Wu, Li Ma, Chien-Pang Chen and Kuansan Wang
skweak: Weak Supervision Made Easy for NLP
Pierre Lison, Jeremy Barnes and Aliaksandr Hubin
Stretch-VST: Getting Flexible With Visual Stories
Chi-yang Hsu, Yun-Wei Chu, Tsai-Lun Yang, Ting-Hao Huang and Lun-Wei Ku
SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text Summarization
Jesse Vig, Wojciech Kryściński, Karan Goel and Nazneen Fatema Rajani
Supporting Complaints Investigation for Nursing and Midwifery Regulatory Agencies
Piyawat Lertvittayakumjorn, Ivan Petej, Yang Gao, Yamuna Krishnamurthy, Anna van der Gaag, Robert Jago and Kostas Stathis
TexSmart: A System for Enhanced Natural Language Understanding
Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang and Shuming Shi
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation
Junyi Li, Tianyi Tang, Gaole He, Jinhao Jiang, Xiaoxuan Hu, Puzhao Xie, Zhipeng Chen, Zhuohao Yu, Wayne Xin Zhao and Ji-Rong Wen
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing
Xiao Wang, Qin Liu, Tao Gui, Qi Zhang, Yicheng Zou, Xin Zhou, Jiacheng Ye, Yongxin Zhang, Rui Zheng, Zexiong Pang, Qinzhuo Wu, Zhengyan Li, Chong Zhang, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xingwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Shan Qin, Bolin Zhu, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu and Xuanjing Huang
TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition
Hanlei Zhang, Xiaoteng Li, Hua Xu, Panpan Zhang, Kang Zhao and Kai Gao
The Classical Language Toolkit: An NLP Framework for Pre-Modern Languages
Kyle P. Johnson, Patrick J. Burns, John D. Stewart, Todd G. Cook, Clément Besnier and William J. B. Mattingly
Trafilatura: A Web Scraping Library and Command-Line Tool for Text Discovery and Extraction
Adrien Barbaresi
TURING: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interface
Peng Xu, Wenjie Zi, Hamidreza Shahidi, Ákos Kádár, Keyi Tang, Wei Yang, Jawad Ateeq, Harsh Barot, Meidan Alon and Yanshuai Cao
TweeNLP: A Twitter Exploration Portal for Natural Language Processing
Viraj Shah, Shruti Singh and Mayank Singh
ESRA: Explainable Scientific Research Assistant
Pollawat Hongwimol, Peeranuth Kehasukcharoen, Pasit Laohawarutchai, Piyawat Lertvittayakumjorn, Aik Beng Ng, Zhangsheng Lai, Timothy Liu and Peerapon Vateekul
MT-Telescope: An interactive platform for contrastive evaluation of MT systems
Ricardo Rei, Ana C Farinha, Craig Stewart, Luisa Coheur and Alon Lavie