GitHub - annieyan/NamedEntityRecognition: NE tagging with structured perceptron, hand-designed features. Use CoNLL-2003 dataset

annieyan / NamedEntityRecognition Public

Notifications You must be signed in to change notification settings
Fork 2
Star 1

NE tagging with structured perceptron, hand-designed features. Use CoNLL-2003 dataset

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
NER_yanan.py		NER_yanan.py
README.txt		README.txt
dev.tiny		dev.tiny
eng.dev.small		eng.dev.small
eng.test.small		eng.test.small
eng.train.small		eng.train.small
feature_generator.py		feature_generator.py
perceptron.py		perceptron.py
utils.py		utils.py

Repository files navigation

************************************************
Named Entity Recognition using perceptron learning
Data: CoNLL-2003
Algorithm: Structured Perceptron
author : An Yan
date: March, 2017
Python version: 2.7
*************************************************

HOW TO RUN:

example:

python NER_yanan.py -t 5 eng.train.small eng.dev.small

** this will output accuracy and classification report
** I did not use  conlleval.txt script, but sklearn classfication report

****************************
parameters: 

-t: the threshold of discarding features that occur less than K times in the training set.
    default = 1. 
test data set 
dev data set or test data set.

*****************************
Help message, please type


python yanan_lm.py -h

************************************************