OpenAI has criticized China's DeepSeek for allegedly copying their work, particularly using a technique called 'distillation' to create a cost-effective AI solution. However, this complaint is seen as ironic by many, as distillation is a common practice in AI development, often involving learning from existing models. Experts like Bill Gurley argue that the majority of advancements in large language models (LLM) are collaborative or derived, making OpenAI's stance appear hypocritical. This situation underscores the interconnectedness of AI innovation, where borrowing ideas is a standard practice.
"What's that saying? Karma's a...well, you know. And if you don't, GPT-4 can easily complete that sentence," Joanna Stern wrote in The Wall Street Journal.
"The vast majority of LLM insights and breakthroughs are 'borrowed'. A community of glass houses," Bill Gurley, the venture capitalist, wrote on X.
Collection
[
|
...
]