Transcript
Sanseviero: My name is Omar Sanseviero.I will talk about open machine learning.I would love to begin talking a bit about the history, at least over the last few years.Three years ago, OpenAI released GPT-2.GPT-2 is a large language model.It has 1.5 billion parameters.It was trained on 8 million webpages, and GPT-2 is trained with a single simple objective, predict which is the next word.
Sanseviero: My name is Omar Sanseviero.I will talk about open machine learning.I would love to begin talking a bit about the history, at least over the last few years.Three years ago, OpenAI released GPT-2.GPT-2 is a large language model.It has 1.5 billion parameters.It was trained on 8 million webpages, and GPT-2 is trained with a single simple objective, predict which is the next word.
[
add
]
[
|
|
...
]