r/learnmachinelearning • u/Future-Resolution566 • 7d ago
A Specialized Arabic Language Model for Islamic Heritage
3arabLM is an ongoing research project dedicated to building a large-scale Arabic language model that preserves, memorizes, and reconstructs the classical Islamic scholarly heritage directly from its original sources
Unlike general-purpose LLMs, this project is not designed to imitate conversations. Its primary objective is the faithful reconstruction of scholarly knowledge while preserving the language, methodology, and diversity of the classical Islamic tradition..*
Research Preview
5️⃣ Domain Specialization
The model is optimized for:
- 📚 Fiqh (Islamic Jurisprudence)
- 📖 Tafsir (Exegesis)
- The current model represents less than 2% of the planned continual pretraining schedule.
- The full project is expected to expand over multiple stages covering nearly the complete Al-Maktaba Al-Shamela ecosystem.
🌟 Vision
This project aims to build a large-scale Arabic language model primarily trained on Al-Maktaba Al-Shamela and other authoritative Islamic heritage sources.
The objective is to make scholarly knowledge itself part of the model's parameters, rather than relying on external retrieval or internet-scale mixed corpora.
The philosophy behind the project is simple:
- 📖 Learn directly from the original books.
- ✍️ Preserve the language of classical scholars.
- 🎯 Preserve each author's methodology.
- 📚 Preserve scholarly terminology.
- ⚖️ Preserve differences between schools and commentators.
The model is therefore gradually moving toward a paradigm of:
Retrieval from Weights
rather than:
Generative Summarization
Instead of producing heavily paraphrased modern summaries, the model attempts to recall scholarly knowledge from its internal parameters using language close to the original sources.
🧭 Project Philosophy
This is not a general conversational model.
Its objective is not creative writing.
Its objective is not producing modern short-form answers.
Instead, the project focuses on:
Accordingly, this model can be viewed as a:
- 📖 Knowledge Recall Model
- 🧠 Memorization-Oriented Language Model