NVIDIA 向博主寄送了 DGX Spark 迷你 AI 主机,其尺寸仅 15 × 15 × 5.05 cm、重 1.2 kg,搭载 GB10 Grace Blackwell 超级芯片与 128 GB CPU/GPU 共享统一内存,FP4 稀疏精度下理论 AI 算力最高 1 petaflop。
.@NVIDIAAI kindly sent me a DGX Spark! As soon as I got back from SF, I unboxed it and wanted to share a first look with you.
It measures just 15 × 15 × 5.05 cm and weighs 1.2 kg. Inside:
• NVIDIA GB10 Grace Blackwell Superchip
• 128 GB of unified memory shared by the CPU and GPU
• Up to 1 petaflop of theoretical AI compute at FP4 precision with sparsity
According to NVIDIA, this little machine can run models with up to 200 billion parameters locally with suitable quantization, and fine-tune models with up to 70 billion parameters using memory-efficient methods such as QLoRA.
You can use it to fine-tune models on your own data, customize image generation, and build AI assistants that run locally. I’m looking forward to trying some of those workflows myself.
Thanks again to the NVIDIA team for sending this over (@NVIDIARTXSpark)! Once I’m back home, I’ll record some hands-on demos of interesting use cases and share what I learn with you.
来源:@kimmonismus · x.com