Skip to content
AIMarketCap

ERNIE 2.0

Model

Continual pre-training framework that incrementally incorporates lexical, syntactic and semantic tasks.

Released
Jul 29, 2019
Context window
—
Modality
text
Open source
—
API available
—
Releases
1

Releases

1
Jul 29, 2019ERNIE 2.0 research releasedERNIE 2.0

Baidu published a continual pre-training framework for incremental multi-task learning.

arXiv Research paperBaiduERNIE 2.0