[SOLVED] AI6127 - Assignment 1- Deep Neural Networks for Natural Language Processing

Description

Question One [50 marks]

1. Download a named entity recognition dataset from https://github.com/leondz/emerging_entities_17, modify the format of the dataset as input to the hands-on implementation of “Named entity recognition by using

CRF” of Lecture 3 Slide 38 and run the hands-on implementation, reporting F-score

[15 marks]

1. Training data: wnut17train.conll (Twitter)
2. Development data: emerging.dev.conll (YouTube)

• Test data: emerging.test.conll (YouTube)

1. Modify the format of the dataset as input to the Softmax classifier of Tutorial 3 and run the Softmax classifier, comparing with the CRF model’s performance in terms of

F-score [15 marks]

1. Optimize the hyper-parameters of the Softmax classifier in terms of F-score, by alternating at least two values of each of the following hyper-parameters [20 marks]:
   1. Window size
   2. Embedding size

• Hidden layer size iv. Number of hidden layers

1. Freeze word embeddings or not
2. Learning rate

• Number of epochs

You may select small numbers of epochs for the optimization experiments if each experiment takes long time. Display the experiment results in a tabular format which compares alternative values of the hyper-parameters.

1