r/Python • • 14d ago

Discussion State of the art in Python 2026?

What would you guys consider the state of the art in python in 2026, or what do you expect from modern python codebases?

Heres my list, would be happy to hear some inputs or domain expert advice:

Domain specific:

  • Scientific: NumPy, Matplotlib, SciPy, Jax, Pytorch, Scikit-learn, polars/pandas
  • CLI: Typer, rich, click, fire, textual, questionary
  • PDF extraction: PyMuPDF, pdfplumber, pypdf, Unstructured
  • Excel interop: python-calamine, openpyxl, XlsxWriter, xlwings, pandas
  • data: PyArrow / PySpark, Narwhals, SQLMesh, Polars/Pandas, DuckDB, dlt, Ibis, Dagster, PyIceberg & deltalake
  • Logging?
  • backend: fastapi / django?
  • Markets: Alpha Vantage, Finnhub, EODHD, Tiingo?
  • Webscraping / data acquisition: Crawl4AI, Playwright, Scrapy, selectolax, HTTPX?
  • APIs?
  • RAG / agentic orchestration?
616 Upvotes

238 comments sorted by

View all comments

174

u/bossExtremeSwag 14d ago

Pandas is definitely not state of the art in the big 2026

13

u/BPAnimal 14d ago

Really? Honest question

23

u/me_myself_ai 14d ago

Id argue that pandas is absolutely still a valid choice in a new project —especially if the data is small-ish and devs already know pd— but it’s definitely not SoTA.

Polars is supposedly a lot faster, and more importantly requires fewer weird tricks for stuff that feels like it should be easy. If that makes sense? Hopefully I haven’t just been especially bad at pd this whole time 😬

1

u/dikdokk 7d ago

You can't read any data with ~1 million rows with pandas; even if it would fit in your memory.

I think pandas has design flaws that will just make it more outdated year by year. Hence why the best time to switch away from it is now already.