#local-llms

#local-llms

As AI takes off, the whole cycle promises to repeat itself again, and while AI might seem relatively cheap now, it might not always be so. Foundational AI model-as-a-service companies charge for insights by the token, and they're doing it at a loss. The profits will have to come eventually, whether that's direct from your pocket, or from your data, you might be interested in other ways to get the benefits of AI without being beholden to a corporation.

ZIO uses a lightweight concurrency model based on fibers, enabling efficient execution of thousands of tasks concurrently on few actual JVM threads.