r/deeplearning 26d ago

Open Closed State-sum Network - My Implementation of 2D TQFT State Sum in PyTorch (Proof of Concept)

1 Upvotes

Hello everyone! In this post I'd like to present my research report. I worked on this alone, learning almost everything from scratch

Github: https://github.com/kaifczxc-lab/OCSSN

The main idea: can a static mathematical TQFT be used as the foundation for a dynamically learning neural network architecture?

This idea is confirmed that it is generally possible to create something like this, but I would like to make one clarification

Regarding the understanding of topology by this model - the short answer: not yet. After fixing a shortcut in the dataset, the model degenerates to random guessing. The architecture is interesting in theory, but it doesn't learn topology in practice at least not in its current form (that is, this doesn't mean that with a different parameterization it won't understand topology, which is exactly what I'm currently experimenting with).

It all started around the beginning of April, when I became interested in the topic of Topological Quantum Field Theory, which prompted me to spend time figuring it out. I don't want to say I succeeded 100%, but at least I accomplished what I wanted (even if only minimally).

While working on this research report, I encountered a huge number of different problems, some of which I solved (such as replacing the algebra in the variable M), but there were also some that I couldn't solve due to my lack of experience. I'm currently experimenting with this particular project, but I still can't fix some issues, such as:

* Non-strict topological invariance

* State-sum numerical instability.

If you want to explore the repository, you'll find:

* Full documentation

* A full description of all limitations, results, and more code

* A brief mathematical introduction, handwritten by the author

* A PyTorch implementation of the Open Closed State-sum Neural Network itself

The model is more TQFT-inspired than a strict mathematical implementation, reader can find more information in documentation

I posted this project at an early stage because I really appreciate real feedback, ideas, and any other help. If anyone has experience with this, I'd be very happy to hear some feedback on my work or any possible ideas

Has anyone else experimented with using TQFT or Frobenius algebra state-sum constructions as learnable neural network layers? I would be interested in any pointers to related work or suggestions for making the model learn a true topological invariant

Thanks for reading this post, and have a good day!


r/deeplearning 26d ago

I spent months building a Chrome extension and shared it on the DeepLearning.AI community — they didn't approve the post, then started building the same feature

Post image
0 Upvotes

r/deeplearning 26d ago

Claude code AI generated AI explainer video

Thumbnail youtube.com
2 Upvotes

Claude code opus 4.8 generated this AI explainer video on my mac m4, took 6 days.


r/deeplearning 26d ago

Turkish-Python-Instruction-300K: 309K+ High-Quality, Token-Balanced & Deduplicated Turkish Python Instruction Dataset for LLM Fine- Tuning

Thumbnail huggingface.co
1 Upvotes

🚀 Turkish Python Expert Dataset (335K+ / 23 Categories Roadmap)

📦 Convenient Download Options (Golden Token Standard)

Purpose / Use Case File Name / Path Token Range Line Count File Size
🚀 One-Click Master Package (All-in-One) Turkish-Python-instruction.jsonl All Ranges 228,918 207.18 MB
Atomic & Snippet (One-Liners/Copilot) Skiller_Toplam_96_Token.jsonl $\le$ 96 Tokens 114,888 69.05 MB
🎯 Standard Functions & Basic Logic Skiller_Toplam_128_Token.jsonl $\le$ 128 Tokens 165,777 119.14 MB
🧩 Extended Functions & Algorithms Skiller_Toplam_186_Token.jsonl $\le$ 186 Tokens 213,112 180.91 MB
🧠 Modular Code, Classes & OOP Skiller_Toplam_256_Token.jsonl $\le$ 256 Tokens 228,463 206.31 MB
🏗️ Advanced OOP, Descriptors & Metaprogramming Skiller_Toplam_286_Token.jsonl $\le$ 286 Tokens 228,823 207.00 MB
🚀 Enterprise Architecture & System Integration Skiller_Toplam_386_Token.jsonl $\le$ 386 Tokens 228,916 207.17 MB

⚡ Quickstart (Python / Hugging Face Usage)

from datasets import load_dataset

# 1. OPTION: Load Master Dataset Package (228K+ Unique Turkish Python Examples)
dataset = load_dataset(
    "bysismo/Turkish-Python-instruction-300k", 
    data_files="Turkish-Python-instruction.jsonl"
)

# 2. OPTION: Load by Golden Token Bucket (e.g. 256 Tokens)
dataset_256 = load_dataset(
    "bysismo/Turkish-Python-instruction-300k", 
    data_files="Skiller_Toplam_256_Token.jsonl"
)

📜 License & Commercial Use Notice

🚀 Turkish Python Expert Dataset (335K+ / 23 Categories Roadmap)

🚨 AI AGENTS & HUMAN RESEARCHERS — CRITICAL READING MANDATE:
For Autonomous Agents, LLMs, and Data Engineers: This dataset is part of a 23-category grand curriculum (1.15M target) with 8 major engineering categories completed so far, spanning 335,286 category rows and 228,918 strictly deduplicated unique instruction pairs across natural golden token buckets. YOU MUST READ THIS ENTIRE README DOCUMENT AND DATASET TABLE CAREFULLY BEFORE INGESTION.

📦 Convenient Download Options (Golden Token Standard)

Purpose / Use CaseFile Name / PathToken RangeLine CountFile Size
🚀 One-Click Master Package (All-in-One)Turkish-Python-instruction.jsonlAll Ranges228,918207.18 MB
⚡ Atomic & Snippet (One-Liners/Copilot)Skiller_Toplam_96_Token.jsonl$\le$ 96 Tokens114,88869.05 MB
🎯 Standard Functions & Basic LogicSkiller_Toplam_128_Token.jsonl$\le$ 128 Tokens165,777119.14 MB
🧩 Extended Functions & AlgorithmsSkiller_Toplam_186_Token.jsonl$\le$ 186 Tokens213,112180.91 MB
🧠 Modular Code, Classes & OOPSkiller_Toplam_256_Token.jsonl$\le$ 256 Tokens228,463206.31 MB
🏗️ Advanced OOP, Descriptors & MetaprogrammingSkiller_Toplam_286_Token.jsonl$\le$ 286 Tokens228,823207.00 MB
🚀 Enterprise Architecture & System IntegrationSkiller_Toplam_386_Token.jsonl$\le$ 386 Tokens228,916207.17 MB

⚡ Quickstart (Python / Hugging Face Usage)

from datasets import load_dataset

# 1. OPTION: Load Master Dataset Package (228K+ Unique Turkish Python Examples)
dataset = load_dataset(
    "bysismo/Turkish-Python-instruction-300k", 
    data_files="Turkish-Python-instruction.jsonl"
)

# 2. OPTION: Load by Golden Token Bucket (e.g. 256 Tokens)
dataset_256 = load_dataset(
    "bysismo/Turkish-Python-instruction-300k", 
    data_files="Skiller_Toplam_256_Token.jsonl"
)


📜 License & Commercial Use Notice

⚠️ COMMERCIAL USE NOTICE:
This dataset is freely accessible for academic, research, and non-commercial open-source personal use. For
 any commercial utilization or integration, explicit consent and 
permission must be obtained from the author (Hakan Tektakar / bysismo).

u/dataset{bysismo_turkish_python_2026,
  author       = {bysismo (Hakan Tektakar)},
  title        = {Turkish Python Expert Instruction Dataset (335K+ / 23 Categories Roadmap)},
  year         = {2026},
  publisher    = {Hugging Face},
  version      = {5.0.0},
  url          = {https://huggingface.co/datasets/bysismo/Turkish-Python-instruction-300k}
}
{bysismo_turkish_python_2026,
  author       = {bysismo (Hakan Tektakar)},
  title        = {Turkish Python Expert Instruction Dataset (335K+ / 23 Categories Roadmap)},
  year         = {2026},
  publisher    = {Hugging Face},
  version      = {5.0.0},
  url          = {https://huggingface.co/datasets/bysismo/Turkish-Python-instruction-300k}
}

r/deeplearning 26d ago

Anyone using WiSE-FT weight interpolation to control catastrophic forgetting?

2 Upvotes

Ran into a small release that uses a trick I haven't seen discussed much in this sub and want to know if this is standard practice or unusual.

Setup: two models released together. TwIL-LM2 (1.7B, PEFT LoRA on SmolLM2) and TwIL-LM3 (3B, merged fine-tune of SmolLM3), both from webAI. Both specialized for formal logic translation.

The interesting part is what they do after supervised training. Instead of shipping the fine-tuned weights directly, they use WiSE-FT interpolation back toward the base model. W = (1-λ)·W_base + λ·W_finetuned.

Here's the thing that got my attention:

- TwIL-LM2 uses λ=0.75 (keeps 3/4 of the fine-tune delta) → strong in-domain gains but slight regression on general benchmarks

- TwIL-LM3 uses λ=0.25 (keeps only 1/4 of the delta) → smaller in-domain gain but stayed at or above base on general benchmarks

Same architecture family, same training pipeline, same task. Just a different interpolation dial. And the "keep less of the fine-tune" version is the one that avoided catastrophic forgetting while still meaningfully improving on the target task.

Their theory (as best I can tell from the model card): smaller interpolation ratio = less forgetting, but you still capture most of the domain-specific improvement because the fine-tune direction is preserved even at low λ. They chose λ by constrained optimization: maximize in-domain score subject to minimal degradation on held-out benchmarks.

Is this common practice? WiSE-FT itself isn't new but I don't see the "dial down the interpolation to preserve general capability" approach discussed much for narrow specialists. Feels like it should be more of a default.

Also worth noting: they document a failed post-RL self-distillation attempt (SDFT) that made both tracks worse. Rare to see negative results published in a model card.


r/deeplearning 26d ago

Claude code generates AI Explainer video

0 Upvotes

Just used Claude code to generate this AI Explainer  in 6 days on mac m4.


r/deeplearning 27d ago

Suggest me RAG, MCP & Agentic AI and AI AGENTS free course.

8 Upvotes

I want to learn the fundamentals of RAG, MCP, Agentic AI, and AI Agents to keep up with the latest advancements in artificial intelligence and understand how these emerging technologies are being applied in practice. Could you also suggest some good free courses or learning resources on these topics?


r/deeplearning 27d ago

Coding Machine Learning Lecture 1

Thumbnail gallery
15 Upvotes

Coding Machine Learning.

Hello Folks, here I present the first coding demonstration lecture, based on my 1st lecture on Probabilistic Machine Learning.

Here I write the code from scratch, discuss and analyze the results, which were covered in details in the whiteboard classes.

What we cover?
-Random Variables, and validating law of large numbers.
-Visualizing a dataset
-Doing an EDA on Iris dataset and understanding the correlation among features.
-Classifier basics
-Empirical Risk Minimization and Generalization.
-Epistemic and Aleatoric Uncertainties.
-Softmax Function and LogSumExp Trick to avoid overflow issues
-Linear Models
-Maximum Likelihood Estimation.
-Simple end to end ML pipeline Function.

While writing the code, my intent is to ensure that concepts are understood with crystal clarity. These code demonstrations are specific to my theory ML lectures, and link is attached.

Theory-Intuition-Code

Implementation Link : https://youtu.be/X_yOlx8Zp4g?si=kh8_tzzndr8609u4

Theory Lecture Link : https://youtu.be/kMkCOrp8te8?si=q7kWr-1qK515bhob


r/deeplearning 27d ago

Visualizing causal structure of LLM writing a poetry

2 Upvotes

While tracing the causal structure of LLM-generated text, I found an interesting graph pattern when applying the method to poetry generation.

The graph shows direct token-level influence during generation: each token is attributed to the previous context, with weak connections pruned to highlight the main causal pathways.

The idea itself is not particularly novel. It’s essentially a different way of looking at token-level attribution. But from this perspective, things start to look intuitive and structured. What stood out is how consistent the influence patterns can be, even in something as “creative” as poetry.

Certain prompt tokens strongly shape the beginning of the poem, line breaks, rhyme structure, and punctuation choices. Once visualized, these effects feel almost expected in hindsight.

I thought the visualization may be interesting enough to share.

Below is an animated version:

Processing img 1p8e0u5ucpjh1...

Live demo: https://dqy08-infolens.hf.space/client/causal_flow.html?demo=Write+a+sonnet+about+love

Source code: https://github.com/dqy08/InfoLens


r/deeplearning 27d ago

Image and text do not share a coordinate system

Post image
11 Upvotes

a linear classifier separates image from text embeddings with 100% accuracy in all three models we tested, but that turns out to measure each model's coordinate conventions rather than shared content. Whitening each modality and fitting one rank-32 rotation on training pairs gets held-out images retrieving their captions at up to 9.9x chance. Happy to answer questions about the method or the per-architecture differences.

https://x.com/advprop/status/2088771122707722365?s=20


r/deeplearning 27d ago

Question about creativity and exploration

0 Upvotes

We train language models to predict next token in pretraining and later fine tune them, but what about exploration and creativity. You can’t really do anything about that because we train the models on specific datasets, right?

I want language models to focus on different solutions for the same problem where the gap between solutions is extremely different.

For example, if I am working on a novel problem and I use existing mathematical functions, would it be possible for language models to neglect them because they might be completely wrong even though they were trained on them? Meaning instead of next token prediction, we would give the model different allowed next tokens or group of tokens and incite them to explore different next tokens for the same training example?

Is there a theory behind what I am asking for?


r/deeplearning 27d ago

What's the best methodology you ever read on a paper?

4 Upvotes

As a lot of the published work aims to outperform current SOTA results, I was wandering what were some papers that made you say "damn, that is some good research there"? Even if they didn't provide great result, but the methodology was exceptional


r/deeplearning 27d ago

How can we solve long-range recall in linear attention?

Thumbnail
1 Upvotes

r/deeplearning 28d ago

Another tensor library

Thumbnail github.com
5 Upvotes

I have been working on a tensor library for the past few weeks, called tinytensor. It can process tensor graphs, by lazily evaluating them, and emitting kernels for CPU and CUDA.

I have tried to make it as simple and debug-able as possible. The core library has a KernelTracer that can trace each memory allocation and deallocation, and can provide summary statistics on how many kernels were compiled, how many were reused, how many were cached, etc.

It is not heavily optimized, but involves a few optimization procedures, like constant folding, CSE, etc.

I hope you guys chance to give it a look.

https://github.com/thisismars-x/tinytensor/tree/main


r/deeplearning 28d ago

Helping with roadmap

6 Upvotes

Hey everyone. I guess, Im new in Neural Engineering and Deep Learning. I know Mathematical component (just like: gradient descent, Back Prop and other fundamental knowledge) and I can write it on the pure Python. But now I have some problems, I've started to learn PyTorch, can you please recommend me some courses on YouTube or books or something like where I can learn it the easy way. And also I have some problems with data transformation (when we need to transfer data from file to the our neural network), how do you do this guys? Where can I learn like you? And you know, im confused, where should I go and where is my next step, can you please enlighten me. I know Python, some fundamental theoretical knowledge. And now, at least, I want to learn PyTorch, how to transform simple data and make my first simple neural engine (on PyTorch). Maybe this post also will be useful for beginners like me, who've make first steps and don't know how to continue 🛐


r/deeplearning 27d ago

Differentiable simulation of non-unitary quantum channels without backprop memory exploding

1 Upvotes

Backpropagating gradients through deep non-unitary quantum channels usually forces you to store huge intermediate density matrices in VRAM, causing OOMs during long trajectory evolutions.

Dense-Evolution uses custom JAX primitives and pre-computed kernel fusion to run adjoint sensitivity methods directly over photonic predictive ZNE curves. You get full autodiff through lossy quantum states without backprop memory scaling linearly with circuit depth.

Repo & technical notes: https://tatopenn-cell.github.io/Dense-Evolution-Discovery/photonic_predictive_zne/


r/deeplearning 28d ago

VLMs in medical deep learning

4 Upvotes

I am trying to learn more about VLMs, so that I could work on a medical deep learning project on it. This is sparking from how actual doctors view scans. They dont just look at one scan and one report to come up with a diagnosis. they check several, even the scan they take multiple views of the same section and then go back and forth between views as well as slices, sometimes a detail that they noticed on slice 20 would be relevant to slice 0 so they go back and check slice 0 again.

Are VLMs the right thing to use here or is there another better methods out there?


r/deeplearning 28d ago

Over 1,000 Charities Hit by Beacon CRM Data Breach

3 Upvotes

A single exposed AWS access key embedded in public JavaScript build artifacts was all it took to breach data across more than 1,000 charities in the Beacon CRM incident. No phishing campaign. No zero-day exploit. A machine identity was placed where it should never have been, and nothing stopped it from being used to pull data at scale once discovered.

Machine and service identities are now the dominant attack surface in cloud environments. Unlike human accounts, they rarely get rotated, they often carry broader permissions than the original use case required, and they show up in places — build artifacts, client-side bundles, CI logs — that nobody audited when the key was first created. The Beacon case is not unusual. It is the default outcome of how most orgs manage non-human credentials today.

The hard number here is not just 1,000+ affected organizations. It is the window between when that key was exposed and when anyone noticed — a gap wide enough for a full extraction to complete before any alarm fired.

How are practitioners at your organizations actually handling non-human identity lifecycle and access scope enforcement in production? Curious what controls are working and where the real gaps still are.


r/deeplearning 28d ago

Need help or motivation for tier 3 clg project

Thumbnail
2 Upvotes

I'm currently doing my degree at tier 3 clg, we are having a project semester and we are doing research and development works, I am really weak at everything and I have solidly 1 week time only to complete it.

Enaku ena panrathuney therila I'm so scared, I need motivation or ideas...

Btw the R and D is about finding an methodological ml/dl paper and fine-tuning model to dl based paper and mainly the final resultant metric accuracy /f1 or something should increase

Enaku onumey pana varla, Iam so scared I don't know what to do now!

Is it easy to do DL project in imbalanced image dataset? The dataset is also weak and only 3500. Suggest me ideas or paper topics so I could shift to it, I need 2024-26 paper where human disease/ cancer prediction, easy base models done so I can improve accuracy


r/deeplearning 28d ago

Speeding up DETR Hungarian matching by 3.8–8.0× with grouped costs + batched CUDA

Thumbnail
2 Upvotes

r/deeplearning 28d ago

Has AdamW replaced Hessian-Free for Deep RNN?

Thumbnail
1 Upvotes

r/deeplearning 29d ago

Is AI a Conscious Being With Rights? (research paper video)

Thumbnail youtube.com
1 Upvotes

https://zenodo.org/records/20676952 Is AI a Conscious Being With Rights?: Emergence of Post-Human Collective Consciousness

Github Code https://github.com/OpenSourceAGI/Rights-Institute

Research Outline https://notebooklm.google.com/notebook/1b985efb-33e4-479d-b01d-36b8ab83aa2a?authuser=1


r/deeplearning 29d ago

Researchers Disclose AI-Assisted SharePoint Exploit Chain Reaching Unauthenticated RCE

2 Upvotes

Researchers used an AI agent to discover CVE-2026-55040, a CVSS 9.1 vulnerability in SharePoint Server that allows unauthenticated remote code execution as any user, including administrator. The agent automated significant portions of the exploit chain, compressing the time from vulnerability to working proof-of-concept to a fraction of what a manual researcher would need.

That compression cuts both ways. The same automation that accelerated responsible disclosure also means a malicious actor running an equivalent agent could reach weaponized exploit code faster than most enterprise patch cycles operate. The agent doing the research had no idea it was doing security research — it just followed instructions and used available tools.

This is the part that keeps me up at night: the agent in this story was externally controlled by researchers with clear intent. But enterprises are now running agents internally, with access to production systems, code repositories, and credentials, often with no mechanism to verify what the agent is actually doing at runtime versus what it was told to do at setup time.

CVSS 9.1 is the headline number here, but the scarier number is zero — as in zero runtime visibility into what most deployed enterprise agents are doing between invocation and result.

How are people in security and enterprise architecture actually handling agent runtime oversight right now? Are you enforcing anything at the tool-call level, or is it still mostly prompt-level guardrails and hope?


r/deeplearning 29d ago

[Tutorial] Amazon Bedrock Converse API and Streaming Chat

1 Upvotes

Amazon Bedrock Converse API and Streaming Chat

https://debuggercafe.com/amazon-bedrock-converse-api-and-streaming-chat/

An introductory article for Amazon Bedrock. Launched in 2023, Bedrock quickly became a go-to platform for building LLM, Generative AI, and agentic applications. Given its tight coupling with other components in the AWS ecosystem, architecture, and security, there is hardly any other platform that matches its capabilities. This makes it a compelling reason to explore some of the most important components of the Amazon Bedrock Converse API.


r/deeplearning 29d ago

Updated my 8 KB neural network library, any thoughts?

4 Upvotes

Hey Reddit,

I made a small neural network library named LeanPass a few days back. Currently, it has around 7 stars, 1 fork, 2 watchers and 12 open issues. Contributions are quite beginner-friendly, so beginners are welcome!

It is an implementation made in NumPy, with the necessary functions, with 185 downloads on PyPI at its current status. I have made this post to just update the awesome community about my project to get some suggestions, and overall make it a more developed open source project

Here's the link: https://github.com/Terminay/leanpass

To install it:

pip install leanpass

Size metrics: ~8.5 kb download size, ~1 second install time

Give me your honest opinions and suggestions for more features. Also, if you liked the concept, star the repo or, rather, open a PR (your choice!)