it shouldn't be able to run models this big
Get $600 off either edition of WiCi One, the first wireless GPU, using my link: https://ntck.co/wici_gpuI ran DeepSeek V4.1 Flash, a 750 billion parameter model that normally needs over 500 GB of memory, on a box with only 32 GB of VRAM. Over Wi-Fi. By the numbers that shouldn't work. The box is WiCi One, a GPU every device in your house can share. In this video you'll learn why big local models don't fit on consumer GPUs, and how WiCi got one running anyway.
☕☕ COFFEE and MERCH: https://ntck.co/coffee
*Sponsored by WiCi
RESOURCES / LINKS:
🖥️ WiCi One (RTX 5060 Ti edition, or the RTX 5090 edition I tested), $600 off with my link: https://ntck.co/wici_gpu
🧠 InferSSD, WiCi's open-source engine for running models bigger than your VRAM off an SSD: https://github.com/wici-ai/inferssd
🤖 DeepSeek V4.1 Flash on Hugging Face: https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash
🎨 Lovart (AI image and video generation): https://www.lovart.ai
🎨 Figma: https://www.figma.com
Figma and Lovart are cloud apps. For this demo, their AI generation requests were redirected to a model running locally on WiCi One.
TIMESTAMPS:
0:00 - The first Wi-Fi GPU: an RTX 5090 my laptop thinks is its own
0:38 - What WiCi One is, and what's inside the box
2:15 - Why Wi-Fi should be way too slow for a GPU
4:37 - The WiCi protocol: how they made the game and GPU stop talking so much
5:36 - From Tencent cloud gaming to a wireless GPU
6:05 - The two problems holding local AI back
7:32 - Why you can't run frontier-size AI models at home
9:57 - The math on running a 750 billion parameter model
11:59 - Mixture of experts, explained with badminton
13:50 - The four tricks that make DeepSeek V4.1 Flash usable on 32 GB of VRAM
15:16 - Running DeepSeek V4.1 Flash live on WiCi One
17:36 - Why GPUs don't like to share
19:41 - Testing WiCi's scheduler: switching AI models with and without it
21:06 - The family GPU: my verdict, pricing and shipping
22:18 - A prayer for you
**Sponsored by WiCi
SUPPORT NETWORKCHUCK:
☕☕ COFFEE and MERCH: https://ntck.co/coffee
READY TO LEARN??
🔥🔥Join the NetworkChuck Academy!: https://ntck.co/NCAcademy
📚 CCNA Course: https://ntck.co/ccna
FOLLOW ME EVERYWHERE:
Instagram: https://www.instagram.com/networkchuck/
X/Twitter: https://x.com/networkchuck
Facebook: https://www.facebook.com/NetworkChuck/
Join the Discord server: https://ntck.co/discord
Some links in this description are affiliate links. If you buy through them, I may earn a small commission at no extra cost to you. #sponsored
#wici #localai #networkchuck Receive SMS online on sms24.me
TubeReader video aggregator is a website that collects and organizes online videos from the YouTube source. Video aggregation is done for different purposes, and TubeReader take different approaches to achieve their purpose.
Our try to collect videos of high quality or interest for visitors to view; the collection may be made by editors or may be based on community votes.
Another method is to base the collection on those videos most viewed, either at the aggregator site or at various popular video hosting sites.
TubeReader site exists to allow users to collect their own sets of videos, for personal use as well as for browsing and viewing by others; TubeReader can develop online communities around video sharing.
Our site allow users to create a personalized video playlist, for personal use as well as for browsing and viewing by others.
@YouTubeReaderBot allows you to subscribe to Youtube channels.
By using @YouTubeReaderBot Bot you agree with YouTube Terms of Service.
Use the @YouTubeReaderBot telegram bot to be the first to be notified when new videos are released on your favorite channels.
Look for new videos or channels and share them with your friends.
You can start using our bot from this video, subscribe now to it shouldn't be able to run models this big
What is YouTube?
YouTube is a free video sharing website that makes it easy to watch online videos. You can even create and upload your own videos to share with others. Originally created in 2005, YouTube is now one of the most popular sites on the Web, with visitors watching around 6 billion hours of video every month.
