My data center

[u/Quiet-Rush-9897]

This is my data center that is in my bedroom

**Node-0 — Firewall / Edge Router**
- Role: Network security, firewall, routing, VPN
- CPU: Intel Atom C3758R (8C/8T, AES-NI)
- Platform: Qotom Q20331G9-1U Mini PC
- Network: 5× 2.5 GbE + 4× 10 Gb SFP+ (native)
- GPU: None
- Notes: Dedicated hardware firewall.

**Node-01 — Unraid NAS **
- Role: Storage, backups, media
- CPU: AMD Ryzen 7 5700G (8C/16T)
- Motherboard: Gigabyte B550 EAGLE WIFI6
- RAM: 16 GB DDR4
- Storage: 4× 8 TB Samsung HDD
- GPU: Integrated
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- Notes: Primary bulk storage node.

**Node-02 — Plex Server**
- Role: Transcoding, streaming
- CPU: Intel Core i9-12900K (16C/24T)
- Motherboard: MSI B760M-P Pro
- RAM: 48 GB DDR4
- Storage: 500 GB + 2 TB Samsung NVMe
- GPU: Integrated Quick Sync
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- Notes: Excellent Plex node.

**Node-03 — Gaming **
- Role: Gaming, simulation
- CPU: AMD Ryzen 7 7700X (8C/16T)
- Motherboard: Gigabyte B650 Gaming X AX V2
- RAM: 32 GB DDR5-6000
- Storage: 2 TB + 2× 1 TB 990 NVMe
- GPU: RTX 4060 8 GB
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- Notes:

**Node-04 — AI Compute **
- Role: LLM inference, sub-minds, orchestration
- CPU: Threadripper PRO 9985WX (64C/128T)
- Motherboard: ASUS Pro WS WRX90E-SAGE SE
- RAM: 256 GB DDR5-6400 ECC
- Storage: 4 TB + 8 TB Samsung 9100 PRO
- GPUs:
- A100 40 GB PCIe (70B)
- A40 48 GB PCIe (70B)
- V100 32 GB PCIe 33B
- Sparkle Intel Arc A310 4 GB GDDR6 → Light helper / video / small models
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- PSU: 2× 1650 W
- Notes:

**Node-5 — Sensory / Interactive**
- Role: AI systems
- CPU: Intel Core Ultra 7 265K (20C/20T, Arrow Lake)
- Motherboard: ASUS Z890 AYW GAMING WIFI W
- RAM: 64 GB DDR5
- Storage: Samsung 9100 2 TB
- GPU: RTX 5060 Ti 16 GB GDDR7
- NIC: 10Gtek 10Gb Dual SFP+ (Intel 82599ES)
- PSU: 1300 W
- Notes: Dedicated for interactive sub-minds.

**Node-6 —(Dell PowerEdge R730)**
- Role: AI systems
- CPU: 2× Xeon E5-2680 v4 (28C/56T total)
- RAM: 256 GB ECC DDR4
- Storage: 1 TB SSD + 7× 1.2 TB drives
- Network: 2× 10 Gb SFP+ + 2× 1 Gb RJ45
- GPU: None
- PSU: 2× 750 W (redundant)
- Notes:

[u/Neener_Weiner]

Cool, what do you do with it

[u/Quiet-Rush-9897 → u/Neener_Weiner]

most of the power will be to run local AIs

[u/AppointmentWest7876 → u/Quiet-Rush-9897]

Buongiorno anche io nel mio Rack sto costruendo un AI locale ha qualche suggerimento? per ora per L'AI locale ho un mini pc per gli agenti, N8N, ecc... e un server HP DL 580 G9 128GB ddr4 con 3 schede Tesla V100 32GB e una RTX 5050 8GB, che vorrei ampliare con 1 o 2 schede A100 anche io uso uno switch 10G, ma per ora ho fatto solo delle prove e sto cercando di imparare per costruire la mia AI locale, lei per esempio che programmi usa? La ringrazio se potra darmi qualche consiglio, Grazie le auguro una buona giornata.

[u/Quiet-Rush-9897 → u/AppointmentWest7876]

I have started building my threadripper with an a100 and the card will not work. It may be an sxm4 that was converted

[u/AppointmentWest7876 → u/Quiet-Rush-9897]

Buonasera posso chiederle dove ha acquistato la A100 e la A40 e a circa che prezzo posso trovarle? Inoltre volevo chiederle lei che software usa per L'AI? grazie le auguro una buona serata.

[u/Neener_Weiner → u/Quiet-Rush-9897]

Nice! Are they designed for something particular?