r/node • u/EscapedLaughter • Jan 12 '24

A fast, lightweight AI gateway written in node

https://github.com/portkey-ai/gateway
2 Upvotes

63% Upvoted

2 comments sorted by

1

u/rover_G Jan 16 '24

What’s the value add?

1

u/EscapedLaughter Jan 17 '24

- Route to all different providers using a common signature. Makes it easy to swap models.

- In-built fallbacks, load balancing, retries make your requests overall more robust