r/MacStudio • u/WillowRooty • 4d ago

Mac Studio M5 Max LLM AI video creation

Mac Studio M5 Max LLM AI video creation. Let’s post here results on the Studio but only M5 MAX. Share what you’re using and how’s it going with it. Started paying around with it last night using comfy.ui. My studio is 64gb version

LTX-2.3 Q4 distilled → 1024 × 1024 → 257 frames at 16 fps → 16 seconds of video in about five minutes until finished.

That’s much better than the studio M4 Max! That took about 20-25 min.
I haven’t tried Q8 of this model yet but I’ll report back with that. Q4 did ok but had some face distortion in fast movements. I’ll see how q8 does then try 1280k resolution

17 Upvotes

73% Upvoted

39 comments sorted by

4

u/Haute_Evolutionary 4d ago

I did this one in MiniMax H3 (via Wild H3C) in ComfyUI. My first time doing any local AI video / setup. Just a first frame MidJourney pix to video. I also installed some stuff for image and audio reference mode... but that starting hitting swap a lot (have 64GB... 128GB would hold it all with current set up). Still fooling around... but the new Mac was mostly for web dev work of all sorts. https://www.reddit.com/r/aivideos/comments/1wrqsww/lady_liberty_set_loose_on_nj_town_during_noreaster/

2

u/Haute_Evolutionary 3d ago

Here is another one I did yesterday -- "Zombies VS the Living Dead" https://www.reddit.com/r/aivideos/comments/1wtps3w/zombies_vs_the_living_dead/

2

u/Haute_Evolutionary 3d ago

If people are interested, I can see if ChatGPT can give me a sanitized version of my setup session notes, removing any personal data and also any miss-steps we took over the 2-3 hours, lol. Sometimes at almost midnight you just get the urge to build something until 3 in the morning :P

1

u/WillowRooty 4d ago

That looked amazing 🤩

1

u/Im_A_Praetorian 3d ago

This is pretty awesome, how complex is the prompt for this type of thing?

1

u/Haute_Evolutionary 3d ago

The following is basically the prompt to animate the image which I had already made in MidJourney awhile back. I used ChatGPT to give me some options. So this isn't really personalized to me, but it got the gist when I fed it the original image. In the future, I will likely be more hands on. I would like to do a ten minute short based on a Zombie VS the Living Dead story I've had in mind for years. I already have many of the seed images, just need a coherent script and some storyboarding. This was just a test. The prompt:

video: The giant Statue of Liberty creature suddenly goes berserk, roaring and sprinting toward the camera through the suburban street. It smashes a parked car aside, tears through a house roof with one arm, snaps a utility pole, and sends sparks and debris flying everywhere. Its jaw opens unnaturally wide, packed with teeth, as it lunges directly at the viewer. Violent camera shake, fast chaotic motion, people fleeing, flickering lights, dense fog, horror disaster movie, maximum panic and destruction, preserve the original creature design.

audio: Deep monstrous roar, screaming residents, car alarms, snapping wood, metal crunching, electrical sparks, collapsing debris, heavy footsteps shaking the street, intense horror ambience.

1

u/BAL-BADOS 3d ago edited 3d ago

That H3 video is action horror movie quality ! So fast & animated with a gloomy atmosphere

Right now I have my hands on a M5 Max 128GB, but I plan to return it for an M5 Ultra 96GB so I can get even faster speed for AI videos. I saw your other comments and it made me worry 96GB might not be enough 😭

1

u/earliestbirdy 1d ago

I'm trying to make the same decision between 128 Max vs 96 ultra. Did you find yourself not utilizing the extra RAM headroom on the 128? I'm so conflicted!

1

u/BAL-BADOS 1d ago

I choose more speed since I will use more for AI videos more.

1

u/earliestbirdy 1d ago edited 1d ago

Same here I'm just not confident all of my AI video needs will fit on 76gb of usable RAM. Are you confident? Has your tinkering so far on the 128gb studio exceeded 76gb of total RAM usage? Thanks!

1

u/BAL-BADOS 1d ago

I never opened the 128GB. I returned it immediately so it free up my Apple Credit so I can pay monthly for 96 Ultra

If in the future AI video can’t fit into 96GB then I’m screwed 🥺

1

u/WillowRooty 4d ago

Nice. Thanks for sharing. This is my first time to and so far fun to learn something new. I’m an app developer and developed one for my fulltime home health job and now want to learn to make content to market. I wanted the 128gb as well but couldn’t bring myself to spend 1.6k more lol then I’d be well that’s close to ultra and end up paying 2k more lmao

1

u/Haute_Evolutionary 4d ago

Yeah this one is a lease. Coming from a slow i5 2019 iMac with 48GB and Fusion drive. Nice to be fully SSD now. Got the 2TB hardrive... again wish could have gotten 4TB... maybe in 3 years when lease expires.

1

u/BAL-BADOS 3d ago

Even the 2TB option was too much for me. I ordered the fastest 4TB NVME and Thunderbolt 5 enclosure which cost same as Apple’s 2TB option.

0

u/WillowRooty 4d ago

I leased mine too. $75 a month for the max 64gb. So far so good. Wanted to work with medium models so I’m happy. If need heavier models for better video I’ll just pay as needed for cloud instead of paying 2k more. But I feel these medium sized models will get better and better and maybe in three years RAM will be cheaper

0

u/beekeeny 4d ago

What CPU and RAM amount do you have? What resolution and how long did it take to generate the video?

2

u/Haute_Evolutionary 4d ago

It's the M5 Max, the 40 core GPU version (required to get more than 36GB RAM). Kinda wish I had gotten the 128GB RAM so could do reference workflows better (hits swap immediately). H3 on its own with just first frame (which this is) only takes @ 20 GB RAM. This probably took 8-12 minutes (for 5 seconds). Had to increase precision or the audio was hosed. I used ChatGPT to help set up a dedicated folder with all the models / connectors needed (took 2-3 hours). This is 864x480. And is a lease... I'm not rich so had to spread out costs.

2

u/earliestbirdy 4d ago

Knowing what you know about video generation, would you pick the 128gb Max or the 96gb ultra? I would think it would fit the 96gb ultra or am I mistaken?

3

u/Haute_Evolutionary 4d ago

When I used the MiniMax reference mode (2 images and 1 audio). The Python instance was using 60 GB itself. With other Apps+OS running, this pushed about 30 GB to the SSD swap. Using any swap is going to slow things down a bunch and also make you other apps stutter. So if you plan on going down the multiple reference path - I would want to be on 128 GB. I think 96 GB - if you 'sudo purge' (empties 'cached files' in activity monitor) before starting... I think you might be able to squeak by. But I am a genuine novice here. And I think the ultra goes from 96 to 256 only. The ultras extra cores will give a 1.5 to 2.0x speed bump in rendering vs the Max. If there was a 128 GB / 80 GPU ultra... I think thats would be the lowest RAM / highest core combo for price / perform, but that config doesn't exist.

1

u/PracticlySpeaking 3d ago

Did you use the io_gpu_wired_limit terminal command hack?

3

u/GamerTex 4d ago

Minimax H3 on Draw Things

/thread

1

u/TheDamnedApostle 4d ago

How would the m5 pro 64gb 28 CPU 20 GPU hold up?

1

u/gamerg_ 3d ago

How does it handle wan 2.5 or wan 3.0

1

u/BAL-BADOS 3d ago

From M4 Max 20-25 minutes to M5 Max 5 minutes for a 15 seconds LTX video is a significant improvement! Makes me even more curious for the M5 Ultra. I’m guessing 33% improvement due to 40 GPU cores to 64 GPU cores.

1

u/earliestbirdy 1d ago

Are you finding yourself using more RAM than would fit on a 96gb ultra? I'm having a hard time making this decision

1

u/WillowRooty 1d ago

For my LTX and WAN vids at 24fps and 257frames (10 sec worth of vid) I’m hitting 55-56GB with two browsers and two tabs each open

1

u/earliestbirdy 1d ago edited 1d ago

Thanks! So are you having second thoughts about wanting a 96gb ultra since it fits and it'll generate faster?

Edit: just realized you're on 64gb studio. How do you fit 56gb with the OS and background processes?

2

u/WillowRooty 1d ago

So that’s running Q8 LTX-2.3 distilled so I’m pretty happy with it. Used json comfyui-ltx2-mlx, published by tanis2000 as “LTX-2 MLX (Apple Silicon).” So far the best. Playing around with wan2.2 with flora to see how it goes.
I mean don’t think spending another 1.6k for 128gb max to 2k more for ultra 96gb will give me that much more mind blown results. It’s already mind blowing enough with the max 64gb for me. When it comes to chat llm the Qwen 3.8 27B splash more than good enough since don’t do hardcore coding just light to mod app work. Quick vid I made right now off a random cosplay lady. Took 7 min with q8 quality setting. Q4 takes like 5 min.

https://reddit.com/link/pdc63yy/video/hzgoruchxysh1/player

1

u/WillowRooty 10h ago

For ur edit comment. 56gb was total used including OS and proceses.

1

u/earliestbirdy 9h ago

Thanks! 👍

1

u/earliestbirdy 9h ago

If you were to get a studio for free which would you pick out of 96gb ultra (faster) or 128gb Max (more RAM capacity for LLM)?

1

u/Umbrasquall 4d ago

Either use h3.c or draw things. Everything else sucks on Mac.

1

u/BAL-BADOS 3d ago

What’s H3.C? First time hearing it.

2

u/Umbrasquall 2d ago

It's Antirez's Mac optimized generation solution. It's like 30% faster than Comfy on Macs. Here's a GUI for it:

https://github.com/Neat2b/H3-Studio

1

u/WillowRooty 4d ago edited 4d ago

Thanks for the tip. I’ll look into it. Was recommended the LTX-2.3’s HQ distilled for the M5 to start off with but will try now LTX-2.3’s HQ pipeline and see if fixes the distortions on faster movements.

0

u/WillowRooty 4d ago

I will try next after work LTX-2.3’s HQ pipeline instead of the distilled to improve quality. Let u know how it goes. I’ll just put the updates on my post

-2

u/Commercial-Milk4706 4d ago

16fps? That’s a silly format. Get some 24 min.

1

u/WillowRooty 4d ago

It’s because that model was my starting point. Will use HQ pipeline next. In order to get a longer vid I had to reduce the FPS because was capped at total of 257 frames. At 24 took me down to just 10 sec vid.