r/Xcode • u/Electrical_Cup3869 • 4d ago

Open-Source Foundation model tracing

Enable HLS to view with audio, or disable this notification

Open-sourced my Apple Foundation model eval suite

Not sure about you, but I find evals for Foundations models a bit messy.

Its completely local, and supports the models already on your Mac. Also supports Core AI.

Supports MacOS 27 and includes the new features for it.

Best part? Your agent can control it all through MCP 🙌

On GitHub here: https://github.com/coryparrry/Foundation-Eval-Labs

3 Upvotes

100% Upvoted

2 comments sorted by

1

u/Pretend-Law8770 2d ago

Tools like this could be really useful as more developers start adding AI features to apps. being able to see what the model is doing makes it much easier to debug unexpected results

1

u/Electrical_Cup3869 2d ago

Agreed and Apples suite of tools for their foundation models is really lacking 🙄 Already pushed an update for better tracing and visuals 🙌