Paper
23 May 2023 Predicting effective arguments based on hybrid language model
Qingyu Li
Author Affiliations +
Proceedings Volume 12645, International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2023); 126453W (2023) https://doi.org/10.1117/12.2681720
Event: International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2023), 2023, Hangzhou, China
Abstract
With the rapid development of information equipment, people's demand for teaching aids is increasing. Among them, the construction of writing aid evaluation system is a challenging task, its difficulty lies in the diversity of writing forms and the diversity of context. In this paper, we propose a Hybrid Model based on an ensemble module, which has the characteristics and advantages of both Roberta and Deberta. Our model includes enhanced mask decoder and disentangled attention transformer layers. At the same time, we used FGM adversarial training to improve model performance. We carried out tests on the Predicting Effective Arguments data set, and experiments showed that the performance of our model far exceeded that of other single models, such as Bert model, Roberta model and Deberta model.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Qingyu Li "Predicting effective arguments based on hybrid language model", Proc. SPIE 12645, International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2023), 126453W (23 May 2023); https://doi.org/10.1117/12.2681720
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Data modeling

Performance modeling

Education and training

Adversarial training

Statistical modeling

Machine learning

Transformers

Back to Top