"OpenAI is building a new team called "Applied Evals," which helps businesses refine complex processes using AI, like refund requests or migrating code. The team will also focus on voice AI and multi-step reasoning tasks, said Shyamal Anadkat, who is leading that team at OpenAI. Pay ranges from $255,000 to $325,000 for the role plus equity, the new listing said."
"Evals refer to measuring the capabilities of AI models, which Anadkat called 'the most critical part of actually building AI products.' Anadkat's post said his team will comprise engineers with 'real, deep, lived expertise.' He said it will start with generalists. He plans to bring in specialists from different fields, such as software engineers for code-related tasks and, perhaps eventually, humanities-focused workers if there is more demand for tasks like writing."
OpenAI launched an Applied Evals team, led by Shyamal Anadkat, to help companies create evaluations for complex, multi-step tasks like refund requests and code migration. The team will prioritize voice AI and multi-step reasoning and will develop metrics to measure model capabilities. Initial hiring targets generalist engineers with deep, lived expertise, with plans to add specialists (software and potentially humanities-focused) as demand grows. The team will collaborate with businesses using OpenAI's developer platform to define evaluation criteria and aims to bring research and product work closer together. Hiring will start small and scale with demand.
Read at Business Insider
Unable to calculate read time
Collection
[
|
...
]