프로젝트
GitHub에서 보기
lonePatient/BERT-NER-Pytorch
lonePatient/BERT-NER-Pytorch has 2,233 GitHub stars and 430 forks. GitHot measured 0 stars in 24 hours, -1 in 7 days, and -3 in 15 days. Last checked 2026-11-21 17:04 UTC. Last push 2023-03-11.
측정된 스타 증가
- in 24h
- 0
- in 7 days
- -1
- in 15 days
- -3
- in 1 month
- 기록 수집 중
서로 겹치는 기간의 순증가량이며 일별 합계가 아닙니다. 측정값이 없으면 비워 둡니다. 스타는 관심도를 나타내며 품질을 보장하지 않습니다.
소개
BERT(Softmax, CRF, Span)를 사용한 중국어 개체명 인식(NER)
머신러닝README.md
OriginalChinese NER using Bert
BERT for Chinese NER.
update:其他一些可以参考,包括Biaffine、GlobalPointer等:examples
dataset list
- cner: datasets/cner
- CLUENER: https://github.com/CLUEbenchmark/CLUENER
model list
- BERT+Softmax
- BERT+CRF
- BERT+Span
requirement
- 1.1.0 =< PyTorch < 1.5.0
- cuda=9.0
- python3.6+
input format
Input format (prefer BIOS tag scheme), with each character its label for one line. Sentences are splited with a null line.
美 B-LOC
国 I-LOC
的 O
华 B-PER
莱 I-PER
士 I-PER
我 O
跟 O
他 O
run the code
- Modify the configuration information in
run_ner_xxx.pyorrun_ner_xxx.sh. sh scripts/run_ner_xxx.sh
note: file structure of the model
├── prev_trained_model
| └── bert_base
| | └── pytorch_model.bin
| | └── config.json
| | └── vocab.txt
| | └── ......
CLUENER result
The overall performance of BERT on dev:
| Accuracy (entity) | Recall (entity) | F1 score (entity) | |
|---|---|---|---|
| BERT+Softmax | 0.7897 | 0.8031 | 0.7963 |
| BERT+CRF | 0.7977 | 0.8177 | 0.8076 |
| BERT+Span | 0.8132 | 0.8092 | 0.8112 |
| BERT+Span+adv | 0.8267 | 0.8073 | 0.8169 |
| BERT-small(6 layers)+Span+kd | 0.8241 | 0.7839 | 0.8051 |
| BERT+Span+focal_loss | 0.8121 | 0.8008 | 0.8064 |
| BERT+Span+label_smoothing | 0.8235 | 0.7946 | 0.8088 |
ALBERT for CLUENER
The overall performance of ALBERT on dev:
| model | version | Accuracy(entity) | Recall(entity) | F1(entity) | Train time/epoch |
|---|---|---|---|---|---|
| albert | base_google | 0.8014 | 0.6908 | 0.7420 | 0.75x |
| albert | large_google | 0.8024 | 0.7520 | 0.7763 | 2.1x |
| albert | xlarge_google | 0.8286 | 0.7773 | 0.8021 | 6.7x |
| bert | 0.8118 | 0.8031 | 0.8074 | ----- | |
| albert | base_bright | 0.8068 | 0.7529 | 0.7789 | 0.75x |
| albert | large_bright | 0.8152 | 0.7480 | 0.7802 | 2.2x |
| albert | xlarge_bright | 0.8222 | 0.7692 | 0.7948 | 7.3x |
Cner result
The overall performance of BERT on dev(test):
| Accuracy (entity) | Recall (entity) | F1 score (entity) | |
|---|---|---|---|
| BERT+Softmax | 0.9586(0.9566) | 0.9644(0.9613) | 0.9615(0.9590) |
| BERT+CRF | 0.9562(0.9539) | 0.9671(0.9644) | 0.9616(0.9591) |
| BERT+Span | 0.9604(0.9620) | 0.9617(0.9632) | 0.9611(0.9626) |
| BERT+Span+focal_loss | 0.9516(0.9569) | 0.9644(0.9681) | 0.9580(0.9625) |
| BERT+Span+label_smoothing | 0.9566(0.9568) | 0.9624(0.9656) | 0.9595(0.9612) |
관련 프로젝트 살펴보기
불러오는 중…