"On Tuesday, Nvidia announced it will begin taking orders for the DGX Spark, a $4,000 desktop AI computer that wraps one petaflop of computing performance and 128GB of unified memory into a form factor small enough to sit on a desk. Its biggest selling point is likely its large integrated memory that can run larger AI models than consumer GPUs."
"With the Spark, Nvidia seeks to address a problem facing some AI developers: Many AI tasks exceed the memory and software capabilities of standard PCs and workstations (more on that below), forcing them to shift their work to cloud services or data centers. However, the actual market for a desktop AI workstation remains uncertain, particularly given the upfront cost versus cloud alternatives, which allow developers to pay as they go."
Nvidia's DGX Spark is a $4,000 desktop AI workstation delivering one petaflop of performance and 128GB of unified memory. Orders open Wednesday, October 15 through Nvidia's website, with systems available from manufacturing partners and select US retail stores. The device targets developers whose tasks exceed standard PC memory and software, enabling local runs of larger models up to roughly 200 billion parameters and fine-tuning of models up to 70 billion parameters. Potential uses include running open-weight language models, media synthesis and image-generation models, vision search and summarization agents, and chatbots. The system weighs 2.65 pounds, measures 5.91 x 5.91 x 1.99 inches, and consumes 240 watts.
Read at Ars Technica
Unable to calculate read time
Collection
[
|
...
]