Portkey: An open-source AI gateway for easy LLM orchestrationThe Portkey AI library allows for load balancing and conditional routing based on user subscriptions.
AI inference platform Groq lands 640M in funding | App Developer MagazineGroq raised $640M in funding to enhance its AI inference capabilities, reflecting strong investor confidence and growing market demand for advanced technology.
Portkey: An open-source AI gateway for easy LLM orchestrationThe Portkey AI library allows for load balancing and conditional routing based on user subscriptions.
AI inference platform Groq lands 640M in funding | App Developer MagazineGroq raised $640M in funding to enhance its AI inference capabilities, reflecting strong investor confidence and growing market demand for advanced technology.
Groq is 'unleashing the beast' to chip away at Nvidia's CUDA advantageGroq is using a free inference tier to attract AI developers, aiming to disrupt Nvidia's dominance in AI computing.
Intro to speculative decoding: Cheat codes for faster LLMsCustom AI accelerators from Cerebras and Groq significantly outperform GPUs in AI inference speed, utilizing advanced techniques like speculative decoding.
AI chip startup Groq rakes in $640M to grow LPU cloudVenture capitalists invest heavily in Groq, enabling its transition to AI infrastructure-as-a-service provider and securing $640 million funding for its inference cloud.
AI chip startup Groq lands $640M to challenge Nvidia | TechCrunchGroq raises $640 million led by Blackrock, values company at $2.8 billion. Groq's LPUs can run AI models faster and more energy-efficiently.