.md .pdf

repository open issue suggest edit

Contents

resources

CoNLL 2003

hanlp.datasets.ner.conll03.CONLL03_EN_DEV = 'https://file.hankcs.com/corpus/conll03_en_iobes.zip#eng.dev.tsv'

Dev set of CoNLL03 (Tjong & De 2003)

hanlp.datasets.ner.conll03.CONLL03_EN_TEST = 'https://file.hankcs.com/corpus/conll03_en_iobes.zip#eng.test.tsv'

Test set of CoNLL03 (Tjong & De 2003)

hanlp.datasets.ner.conll03.CONLL03_EN_TRAIN = 'https://file.hankcs.com/corpus/conll03_en_iobes.zip#eng.train.tsv'

Training set of CoNLL03 (Tjong & De 2003)

MSRA

hanlp.datasets.ner.msra.MSRA_NER_CHAR_LEVEL_DEV = 'http://file.hankcs.com/corpus/msra_ner.zip#dev.tsv'

Dev set of MSRA (Levow 2006) in character level.

hanlp.datasets.ner.msra.MSRA_NER_CHAR_LEVEL_TEST = 'http://file.hankcs.com/corpus/msra_ner.zip#test.tsv'

Test set of MSRA (Levow 2006) in character level.

hanlp.datasets.ner.msra.MSRA_NER_CHAR_LEVEL_TRAIN = 'http://file.hankcs.com/corpus/msra_ner.zip#train.tsv'

Training set of MSRA (Levow 2006) in character level.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_IOBES_DEV = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.dev.tsv'

Dev set of MSRA (Levow 2006) in token level.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_IOBES_TEST = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.test.tsv'

Test set of MSRA (Levow 2006) in token level.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_IOBES_TRAIN = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.train.tsv'

Training set of MSRA (Levow 2006) in token level.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_SHORT_IOBES_DEV = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.dev.short.tsv'

Dev set of shorten (<= 128 tokens) MSRA (Levow 2006) in token level.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_SHORT_IOBES_TEST = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.test.short.tsv'

Test set of shorten (<= 128 tokens) MSRA (Levow 2006) in token level.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_SHORT_IOBES_TRAIN = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.train.short.tsv'

Training set of shorten (<= 128 tokens) MSRA (Levow 2006) in token level.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_SHORT_JSON_DEV = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.dev.short.jsonlines'

Dev set of shorten (<= 128 tokens) MSRA (Levow 2006) in token level and jsonlines format.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_SHORT_JSON_TEST = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.test.short.jsonlines'

Test set of shorten (<= 128 tokens) MSRA (Levow 2006) in token level and jsonlines format.

hanlp.datasets.ner.msra.MSRA_NER_TOKEN_LEVEL_SHORT_JSON_TRAIN = 'http://file.hankcs.com/corpus/msra_ner_token_level.zip#word_level.train.short.jsonlines'

Training set of shorten (<= 128 tokens) MSRA (Levow 2006) in token level and jsonlines format.

OntoNotes5

hanlp.datasets.srl.ontonotes5.chinese.ONTONOTES5_CONLL12_CHINESE_TRAIN = 'https://catalog.ldc.upenn.edu/LDC2013T19/LDC2013T19.tgz#/ontonotes-release-5.0/data/../conll-2012/chinese/train.chinese.conll12.jsonlines'

Training set of OntoNotes5 used in CoNLL12 (Pradhan et al. 2012).

hanlp.datasets.srl.ontonotes5.chinese.ONTONOTES5_CONLL12_CHINESE_DEV = 'https://catalog.ldc.upenn.edu/LDC2013T19/LDC2013T19.tgz#/ontonotes-release-5.0/data/../conll-2012/chinese/development.chinese.conll12.jsonlines'

Dev set of OntoNotes5 used in CoNLL12 (Pradhan et al. 2012).

hanlp.datasets.srl.ontonotes5.chinese.ONTONOTES5_CONLL12_CHINESE_TEST = 'https://catalog.ldc.upenn.edu/LDC2013T19/LDC2013T19.tgz#/ontonotes-release-5.0/data/../conll-2012/chinese/test.chinese.conll12.jsonlines'

Test set of OntoNotes5 used in CoNLL12 (Pradhan et al. 2012).

hanlp.datasets.srl.ontonotes5.chinese.ONTONOTES5_CONLL12_NER_CHINESE_TRAIN = 'https://catalog.ldc.upenn.edu/LDC2013T19/LDC2013T19.tgz#/ontonotes-release-5.0/data/../conll-2012/chinese/train.chinese.conll12.ner.tsv'

Training set of OntoNotes5 used in CoNLL12 (Pradhan et al. 2012).

hanlp.datasets.srl.ontonotes5.chinese.ONTONOTES5_CONLL12_NER_CHINESE_DEV = 'https://catalog.ldc.upenn.edu/LDC2013T19/LDC2013T19.tgz#/ontonotes-release-5.0/data/../conll-2012/chinese/development.chinese.conll12.ner.tsv'

Dev set of OntoNotes5 used in CoNLL12 (Pradhan et al. 2012).

hanlp.datasets.srl.ontonotes5.chinese.ONTONOTES5_CONLL12_NER_CHINESE_TEST = 'https://catalog.ldc.upenn.edu/LDC2013T19/LDC2013T19.tgz#/ontonotes-release-5.0/data/../conll-2012/chinese/test.chinese.conll12.ner.tsv'

Test set of OntoNotes5 used in CoNLL12 (Pradhan et al. 2012).

Resume

hanlp.datasets.ner.resume.RESUME_NER_DEV = 'https://github.com/jiesutd/LatticeLSTM/archive/master.zip#ResumeNER/dev.char.bmes'

Dev set of Resume in char level.

hanlp.datasets.ner.resume.RESUME_NER_TEST = 'https://github.com/jiesutd/LatticeLSTM/archive/master.zip#ResumeNER/test.char.bmes'

Test set of Resume in char level.

hanlp.datasets.ner.resume.RESUME_NER_TRAIN = 'https://github.com/jiesutd/LatticeLSTM/archive/master.zip#ResumeNER/train.char.bmes'

Training set of Resume in char level.

Weibo

hanlp.datasets.ner.weibo.WEIBO_NER_DEV = 'https://github.com/hltcoe/golden-horse/archive/master.zip#data/weiboNER_2nd_conll.dev'

Dev set of Weibo in char level.

hanlp.datasets.ner.weibo.WEIBO_NER_TEST = 'https://github.com/hltcoe/golden-horse/archive/master.zip#data/weiboNER_2nd_conll.test'

Test set of Weibo in char level.

hanlp.datasets.ner.weibo.WEIBO_NER_TRAIN = 'https://github.com/hltcoe/golden-horse/archive/master.zip#data/weiboNER_2nd_conll.train'

Training set of Weibo in char level.

json dep