""It's so hard because you see all these amazing things, and someone comes and pitches another amazing thing, and you're like, yes, that is amazing," he said. He explained that the company divides its computing power between research and applied products. The company's chief scientist and research head decide allocations within the research side. Senior leadership - CEO Sam Altman and the CEO of applications, Fidji Simo - decide the overall split between research and applied teams."
"At the operational level, a small internal team focuses on shuffling GPU assignments, including Kevin Park, who is responsible for redistributing hardware as projects wind down. "You go to him and you're just like, 'OK, like we need this many more GPUs for this project that just came up,'" Brockman said. "And he's like, 'All right, there's like these five projects that are sort of winding down,'" he added."
Decisions about GPU allocation at OpenAI are emotionally taxing because many compelling projects compete for scarce compute resources. Computing power is split between research and applied product teams, with the chief scientist and research head allocating within research while senior leadership determines the overall split. A small operational team manages GPU reassignment as projects wind down, with specific staff responsible for redistributing hardware. Compute availability directly drives team productivity, and competition for GPU access generates significant energy and emotion around who receives compute resources amid broader market scarcity.
Read at Business Insider
Unable to calculate read time
Collection
[
|
...
]