OpenAI has released two open weight LLMs, gpt-oss-120b and gpt-oss-20b, which can perform similarly to recent small language models on accessible hardware.
Andrew Ng highlighted how aisuite simplified the process of using multiple LLM providers by allowing developers to switch models with a simple string change. This dramatically improves efficiency and the development experience.
The testing on different downstream tasks, including fine-tuning and quantization, shows that while fine-tuning can improve task effectiveness, it can simultaneously increase jailbreaking vulnerabilities in LLMs.