conll-shared-tasks-progressed-increasing-abstraction-1999-2019

IN premisesummaries/2026/08/24/wiki-Natural_language_processing-chunk-2.md

Created 2026-08-24T17:11:18+00:00

CoNLL shared tasks progressed in linguistic abstraction over two decades: shallow parsing (1999–2001), NER (2002–03), dependency syntax (2006–09), SRL (2004–05, 2008–09), coreference (2011–12), discourse parsing (2015–16), and semantic parsing (2019).

Summary

This documents a clear historical arc in natural language processing benchmarking: over twenty years, the annual CoNLL challenges steadily moved from easy surface-level tasks like breaking text into sentences toward deep meaning-level tasks like figuring out what a whole sentence is trying to say. It matters because it establishes a concrete baseline for what "progress" looks like in the field and sets the yardstick against which newer systems and benchmarks are measured.