"You have to show [an AI model] tens of thousands of examples of good behavior, and you have to fine-tune those into the model. The good news is that tens of thousands of examples are very accessible to many niche domains or specific verticals. So that's an edge and I think there's plenty of room for startups in doing high-quality fine-tuning of a pre-trained model."
"We're going to sort of compress knowledge into smaller, cheaper models, which can live on a fridge magnet. Training a large AI model currently takes about $100 million, with more advanced models expected to cost billions of dollars."
"I think that with respect to content that is already on the open web, the social contract of that content since almost all content on the Internet is fair game for AI training, except for those that have opted out."
Collection
[
|
...
]