Natural Language Annotation for Machine Learning: A Guide to Corpus-Building for Applications (1)

By: James Pustejovsky and Amber Stubbs

Sign Up Now! Already a Member? Log In
You must be logged into Bookshare to access this title. Learn about membership options, or view our freely available titles.

Synopsis: Create your own natural language training corpus for machine learning. Whether you’re working with English, Chinese, or any other natural language, this hands-on book guides you through a proven annotation development cycle—the process of adding metadata to your training corpus to help ML algorithms work more efficiently. You don’t need any programming or linguistics experience to get started.Using detailed examples at every step, you’ll learn how the MATTER Annotation Development Process helps you Model, Annotate, Train, Test, Evaluate, and Revise your training corpus. You also get a complete walkthrough of a real-world annotation project.Define a clear annotation goal before collecting your dataset (corpus)Learn tools for analyzing the linguistic content of your corpusBuild a model and specification for your annotation projectExamine the different annotation formats, from basic XML to the Linguistic Annotation FrameworkCreate a gold standard corpus that can be used to train and test ML algorithmsSelect the ML algorithms that will process your annotated dataEvaluate the test results and revise your annotation taskLearn how to use lightweight software for annotating texts and adjudicating the annotationsThis book is a perfect companion to O’Reilly’s Natural Language Processing with Python.