Model Name,Developer,Architecture,Number of Parameters,Year Released
GPT-3,OpenAI,Transformer,175 billion,2020
BERT,Google,Bidirectional Transformer,110 million,2018
T5,Google,Text-to-Text Transformer,11 billion,2019
XLNet,Google Brain,Permutation-based Transformer,340 million,2019
RoBERTa,Facebook AI,Bidirectional Transformer,355 million,2019
ALBERT,Google Research & Toyota Technological Institute at Chicago,Bidirectional Transformer,12 million,2019
ELECTRA,Google Research,Transformer,335 million,2020