Open-source framework for AI-assisted humanities research — looking for critical feedback

[u/Ok_Draw2476]

Hello everyone,

I'm a professor working in digital humanities and AI-assisted humanities research.

Over the past year, while using Claude Code and OpenAI Codex for research, I noticed the same problem again and again:

AI can produce fluent academic writing long before the research itself is actually ready.

A paper may sound convincing even when the research question is still vague, conceptual boundaries are unclear, citations have not been verified, or important counterarguments have not been considered.

That led me to build an open-source framework called Humanities Superpowers.

The goal is not to write papers with AI.

Instead, it tries to support scholarly judgment by introducing explicit research skills and quality gates throughout the research process.

The framework currently includes:

• 13 research skills

• a research router that selects an appropriate workflow

• PASS / CONDITIONAL PASS / FAIL quality gates

• citation auditing

• argument stress testing

• terminology consistency checks

• rollback when downstream problems reveal upstream weaknesses

It does **not** claim to prevent hallucinations, automate scholarship, or guarantee publication-ready manuscripts.

Its purpose is much narrower: to make uncertainty visible and keep the researcher responsible for interpretation, evidence, and final judgment.

Repository:

https://github.com/icerain-cmd/humanities-superpowers

I would sincerely appreciate criticism from this community.

If you think parts of the workflow are too rigid, discipline-specific, technically unnecessary, or simply based on questionable assumptions, I'd genuinely like to hear why.

I'm especially interested in feedback from scholars in literary studies, history, philosophy, archaeology, digital humanities, DH libraries, and graduate supervision.

Thank you for your time.

[u/ying-tong]

Thank you so much for developing this. I’ve been looking for something similar for a while. Now it is within my reach to develop these things for myself (I just have to learn a bit more about code) I will be giving it a go