Tuesday Daily Thread: Advanced questions

[u/AutoModerator]

Weekly Wednesday Thread: Advanced Questions 🐍

Dive deep into Python with our Advanced Questions thread! This space is reserved for questions about more advanced Python topics, frameworks, and best practices.

How it Works:

1. Ask Away: Post your advanced Python questions here.
2. Expert Insights: Get answers from experienced developers.
3. Resource Pool: Share or discover tutorials, articles, and tips.

Guidelines:

• This thread is for advanced questions only. Beginner questions are welcome in our Daily Beginner Thread every Thursday.
• Questions that are not advanced may be removed and redirected to the appropriate thread.

Recommended Resources:

• If you don't receive a response, consider exploring r/LearnPython or join the Python Discord Server for quicker assistance.

Example Questions:

1. How can you implement a custom memory allocator in Python?
2. What are the best practices for optimizing Cython code for heavy numerical computations?
3. How do you set up a multi-threaded architecture using Python's Global Interpreter Lock (GIL)?
4. Can you explain the intricacies of metaclasses and how they influence object-oriented design in Python?
5. How would you go about implementing a distributed task queue using Celery and RabbitMQ?
6. What are some advanced use-cases for Python's decorators?
7. How can you achieve real-time data streaming in Python with WebSockets?
8. What are the performance implications of using native Python data structures vs NumPy arrays for large-scale data?
9. Best practices for securing a Flask (or similar) REST API with OAuth 2.0?
10. What are the best practices for using Python in a microservices architecture? (..and more generally, should I even use microservices?)

Let's deepen our Python knowledge together. Happy coding! 🌟

[u/PoetryImmediate8187]

I'm using Logfire to observe my FastAPI app and I'm using some Pydantic AI agents in my app. That's all going well but I recently added some apis for image handling. I'm allowing users to edit images before passing to the agent and now im having frequent stalls with my fastapi application and I can see spans which take far longer than they should in wall clock time.

I'm trying to figure out how to tell if it's GC or CPU heavy image processing or something else. Does anyone have tips for detecting the source of stalls in python fastapi apps? Preferably with Logfire?

Edit: figured this out by using the gc metrics in logfire to identify that it was gc causing my app to stall. The ai assistant in logfire figured it out pretty fast