# NVIDIA DGX Spark - Unboxing, Setup, and Initial Thoughts Source: https://www.youtube.com/watch?v=p19W2AQotEg Recap page: https://rapidrecap.app/video/p19W2AQotEg Generated: 2025-12-29T15:06:52.531+00:00 --- ## Quick Overview The NVIDIA DGX Spark unboxing and setup reveals a compact AI supercomputer designed for developers, featuring a Grace Blackwell Superchip, 128 GB of unified memory, and pre-installed NVIDIA AI software stack, which allows for running large language models locally with high performance, demonstrated through successful initial setup via Wi-Fi and subsequent SSH access to run Python scripts utilizing the GPU. **Key Points:** - The NVIDIA DGX Spark is a compact AI supercomputer powered by the NVIDIA GB10 Grace Blackwell Superchip, offering one petaFLOP of AI performance. - The device comes pre-packaged with the NVIDIA AI software stack and 128 GB of unified memory, supporting local inference and fine-tuning of models up to 200 billion parameters. - Initial setup involves connecting to the device's Wi-Fi hotspot ('spark-020e') and accessing a local address (http://spark-020e.local) via a web browser. - The speaker successfully established a connection using NVIDIA Sync, which facilitates SSH access to the device. - The system runs a custom Linux kernel, and the speaker verified the GPU (NVIDIA GR010) and CUDA Version 13.0 using 'nvidia-smi'. - The speaker installed Python 3.12.3 and demonstrated running a test script using a 4-bit quantized LLM ('HuggingFaceTB/SmoLLM3-3B') for inference, noting good performance for local LLM execution. ![Screenshot at 00:02: The presenter holds up the brown shipping box labeled 'NVIDIA DGX Spark', introducing the device which is designed for local AI development and inference.](https://ss.rapidrecap.app/screens/p19W2AQotEg/00-00-02.jpg) **Context:** The video provides an unboxing, initial setup guide, and first impressions of the NVIDIA DGX Spark, a small form-factor AI supercomputer aimed at developers for local AI workload execution. The presenter details the physical hardware, the steps taken to connect to the device over a network, and verifies the system's capability by running a Python script that loads and queries a large language model (LLM) using the integrated GPU. ## Detailed Analysis The video begins with the unboxing of the NVIDIA DGX Spark, highlighting its small, compact form factor. The speaker notes that the device is powered by the NVIDIA GB10 Grace Blackwell Superchip and delivers one petaFLOP of AI performance using FP4 precision with sparsity. A major advantage is that the NVIDIA AI software stack is pre-installed, along with 128 GB of unified memory, making it ready for prototyping and inference of large models locally. The initial setup process is demonstrated, which involves connecting the host computer to the DGX Spark's dedicated Wi-Fi hotspot ('spark-020e') and accessing the setup utility via a local web address. After connecting, the speaker installs NVIDIA Sync, which sets up SSH access. Once connected via SSH, the speaker verifies the system details by running 'nvidia-smi', confirming the presence of an NVIDIA GR010 GPU and CUDA Version 13.0. The speaker then sets up a Python environment using Conda and successfully runs two test scripts: one to confirm library availability (like 'transformers') and another using a small 4-bit quantized LLM ('HuggingFaceTB/SmoLLM3-3B') to explain quantum mechanics, showing active GPU utilization during inference. The speaker concludes that the unified memory architecture and built-in software make the setup process smooth and the device highly capable for running large models locally, despite the theoretical performance being based on FP4 precision. ### Unboxing and Hardware Overview - DGX Spark box displayed - Device has a porous, textured gold/tan finish - Ports include power, three USB-C ports, HDMI, Ethernet, and two other slots - Device integrates a GB10 Grace Blackwell SoC. ### Initial Setup Process - Setup involves connecting via the device's Wi-Fi hotspot ('spark-020e') - Setup utility accessed via http://spark-020e.local - Connection established using NVIDIA Sync for SSH access. ### System Verification and Environment Setup - 'nvidia-smi' confirms NVIDIA GR010 GPU and CUDA Version 13.0 - Python 3.12.3 installed via Conda environment creation ('conda create -n spark python=3.12.3') - Conda environment activated ('conda activate spark'). ### AI Model Testing - Tested inference using 'lm_test.py' with a 4-bit quantized LLM ('HuggingFaceTB/SmoLLM3-3B') - Test query: 'Give me a brief explanation of gravity in simple terms.' - Second test using 'gpt-oss.py' with a model loaded in FP4 precision. ### Performance Observations - GPU utilization reached 70-90% during LLM inference - The 128 GB unified memory is highly beneficial for running large models locally, even those requiring FP4 precision. ![Screenshot at 00:02: The presenter holds up the brown shipping box labeled 'NVIDIA DGX Spark', introducing the device which is designed for local AI development and inference.](https://ss.rapidrecap.app/screens/p19W2AQotEg/00-00-02.jpg) ![Screenshot at 00:31: The presenter displays the DGX Spark Quick Start Guide, which includes instructions for initial setup.](https://ss.rapidrecap.app/screens/p19W2AQotEg/00-00-31.jpg) ![Screenshot at 00:39: Close-up view of the rear ports on the DGX Spark: power plug, three USB-C ports, HDMI, Ethernet, and two expansion slots.](https://ss.rapidrecap.app/screens/p19W2AQotEg/00-00-39.jpg) ![Screenshot at 01:55: The NVIDIA DGX Dashboard interface is shown on screen, displaying system memory \(4.93 GB used of 128 GB\) and 0% GPU utilization while JupyterLab is stopped.](https://ss.rapidrecap.app/screens/p19W2AQotEg/00-01-55.jpg) ![Screenshot at 03:54: The screen shows the 'Install NVIDIA Sync' step on the setup documentation, indicating the method for establishing SSH connection to the DGX Spark.](https://ss.rapidrecap.app/screens/p19W2AQotEg/00-03-54.jpg)