A Charge Prediction Method Based on Graph Attention Network: CP-GAT

doi:10.12068/j.issn.1005-3026.2021.12.002

Abstract

Abstract: The task of charge prediction is to predict the charge of a case based on text data. Aiming at the problem that the existing methods do not perform well on similar charges and long tail datasets， a case charge prediction method was proposed based on graph attention network(CP-GAT). Firstly， the case event description text in the judicial document data set and the corresponding legal information of the case are used to establish the heterogeneous graph structure data. The constructed heterogeneous graph contains two types of nodes(word nodes and case nodes)， two types of edges(the edges connected by word nodes and word nodes， the edges connected by word nodes and case nodes). The graph attention network was used to extract graph features on the heterogeneous graph constructed based on texts， and finally the obtained feature vector was input into the classifier of charge prediction to get the charge of the case. The experimental results on the CAIL2018 legal dataset show that the charge prediction method based on graph attention network is better than the model used in the comparative experiment， and the accuracy and macro F1 value reach 95.2% and 66.1 respectively， which verifies that the proposed method is conducive to improving the performance of the case charge prediction task.

Key words: graph attention network; charge prediction; node feature extraction; heterogeneous graph; law article information

CLC Number:

TP391

ZHAO Qi-hui， LI Da-peng， GAO Tian-han， WEN Ying-you. A Charge Prediction Method Based on Graph Attention Network: CP-GAT[J]. Journal of Northeastern University(Natural Science), 2021, 42(12): 1681-1687.

References

[1]Zhong H X，Xiao C J，Tu C C，et al.How does NLP benefit legal system:a summary of legal artificial intelligence ［C］// Proceedings of the 58th Annal Meeting of the Association for Computational Linguistics.Online，2020:5218-5230.
[2]李强，李瑶坤，夏书月，等.一种改进的医疗文本分类模型:LS-GRU［J］.东北大学学报(自然科学版)，2020，41(7):938-943.(Li Qiang， Li Yao-kun， Xia Shu-yue，et al.An improved medical text classification model:LS-GRU［J］.Journal of Northeastern University(Natural Science)， 2020，41(7):938-943.)
[3]Kort F.Predicting supreme court decisions mathematically:a quantitative analysis of the right to counsel cases［J］.American Political Science Review，1957，51(1):1-12.
[4]Nagel S S.Applying correlation analysis to case prediction［J］.Texas Law Review，1964，42(7):1006-1017.
[5]Liu C L，Hsieh C D.Exploring phrase-based classification of judicial documents for criminal charges in Chinese ［C］// Proceedings of International Symposium on Methodologies for Intelligent Systems.Bari，2006:681-690.
[6]Liu Y H，Chen，Y L，Ho，W L.Predicting associated statutes for legal problems［J］.Information Processing & Management，2015，51(1):194-211.
[7]Katz D M，Nd B M，Blackman J.A general approach for predicting the behavior of the supreme court of the united states［J］.Plos One，2014，12(4):e0174698.
[8]Luo B F，Feng Y S，Xu J B，et al.Learning to predict charges for criminal cases with legal basis ［C］// Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.Copenhagen，2017:2727-2736.
[9]Jiang X，Ye H，Luo Z C，et al.Interpretable rationale augmented charge prediction system ［C］//Proceedings of the 27th International Conference on Computational Linguistics:System Demonstration.Santa Fe:ACL，2018:146-151.
[10]Long S B，Tu C C，Liu Z Y，et al.Automatic judgment prediction via legal reading comprehension［EB/OL］.［2021-01-10］.arXiv preprint arXiv:1809.0653.
[11]Zhong H X，Guo Z P，Tu C C，et al.Legal judgment prediction via topological learning ［C］// Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.Brussels，2018:3540-3549.
[12]Duan W，Li L.An external knowledge enhanced multi-label charge prediction approach with label number learning［EB/OL］.［2021-01-10］.arXiv:1907.02205v1.
[13]Velikovi P，Cucurull G，Casanova A，et al.Graph attention networks ［C］//Proceedings of the 6th International Conference on Learning Representations.Vancouver，2018:1-12.
[14]Yao L，Mao C S，Luo Y.Graph convolutional networks for text classification ［J］.Proceedings of the AAAI Conference on Artificial Intelligence，2019，33:7370-7377..
[15]Xiao C J，Zhong H X，Guo Z P，et al.CAIL2018:a large-scale legal dataset for judgment prediction［EB/OL］.［2021-01-10］.arXiv preprint arXiv:1809.0653.
[16]Salton G，Buckley C.Term-weighting approaches in automatic text retrieval［J］.Information Processing & Management， 1988，24(5):513-523.
[17]Kipf T N，Welling M.Semi-supervised classification with graph convolutional networks ［C］// Proceedings of the 5 th International Conference on Learning Representations.Toulon，2017:1-14.
[18]Li Y，Tarlow D，Brockschmidt M，et al.Gated graph sequence neural networks ［C］// Proceedings of the 4th International Conference on Learning Representations.San Juan，2016:1-20.
[19]Suykens J A，Vandewalle J.Least squares support vector machine classifiers［J］.Neural Processing Letters，1999，9(3):293-300.
[20]Kim Y.Convolutional neural networks for sentence classification［C］// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing.Doha，2014:1746-1751.
[21]Lai S W，Xu L H，Liu K，et al.Recurrent convolutional neural networks for text classification［C］// Proceedings of the 29th National Conference on Artificial Intelligence.Austin，2015:2267-2273.
[22]Yang Z，Yang D，Dyer C，et al.Hierarchical attention networks for document classification ［C］// Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.San Diego，2016.
[23]Li Z，Sun M.Punctuation as implicit annotations for Chinese word segmentation［J］.Computational Linguistics，2009，35(4):505-512.
[24]Mikolov T，Chen K，Corrado G，et al.Efficient estimation of word representations in vector space ［C］// Proceedings of International Conference on Intelligent Text Processing and Computational Linguistics.Berlin:Springer，2013:430-443.
[25]Kingma D P，Ba J.Adam:a method for stochastic optimization ［C］// The 3rd International Conference for Learning Representations.San Diego，2015:1-15.