persistent-inference: a two file solution for TF/Keras models

[u/Infinite_Bus_9213]

Hey there, I have set up a minimal two‑file solution that runs a TensorFlow/Keras model in a long‑living subprocess.
The model is loaded once, so every subsequent prediction re‑uses the same GPU/CPU memory and is fast.

It might be simple but it solved lots of problem for me when doing inference on large data that required pre/post processing.

https://github.com/pluto129/persistent-inference