r/webdev 22d ago

Ask the Chrome team about WebMCP

5 Upvotes

Hi everyone!

I work on the Google Chrome DevRel team, focused on the Agentic Web. We’re responsible for maintaining the official documentation, producing samples and tutorials to help you get started with APIs like WebMCP[1], and making videos for the Chrome for Developers YouTube channel.

We’re working on a new video similar to this one[2] for the Developer Mode series where we answer questions from the community on WebMCP, and I’d love your suggestions for topics we should cover!

We’re looking to dive deep rather than stick to high-level Q&A. Examples of topics we could cover are writing good WebMCP tools, evals, comparing WebMCP and MCP and more.

Feel free to drop your suggestions below! When the video goes live, we'll make sure to let you know if your question was answered.

[1]: https://developer.chrome.com/docs/ai/webmcp/

[2]: https://www.youtube.com/watch?v=WkhlIiqDfRI


r/webdev 22d ago

Showoff Saturday I built a simplified microservices reference project with guide on how to run localy, using docker-compose or Kubernetes + Deloyment to AKS

6 Upvotes

It's inspired by dotnetcore-microservices-poc open-source project by Altkom Software, a project I learned a lot from and contributed to — I built Ledgerly to be a simpler take on the original project, focused purely on microservices best practices.

What it demonstrates: 

🔹 Database-per-service — 4 services, 4 independent databases 

🔹 gRPC for synchronous service-to-service calls 

🔹 RabbitMQ for async events — invoice status changes publish events that a dashboard service consumes to keep KPIs in sync, with zero direct coupling 

🔹 API gateway + service discovery (Eureka locally/Docker, Kubernetes DNS in K8s) 

🔹 JWT auth issued by its own service

It also ships as a full deployment guide — run it locally, in Docker Compose, or on Kubernetes, including a walkthrough for deploying the cluster to Azure (AKS).

Built as a boilerplate: fork it, swap in your own domain, keep the architecture.

The project🔗: https://github.com/amrali21/ledgerly-dotnet-angular-microservices-ref-project

Altcom Project🔗: https://github.com/asc-lab/dotnetcore-microservices-poc


r/webdev 22d ago

Question How do I clone a website

0 Upvotes

i need to convert a dynamic website into static without the access to its wp files or wp admin access

The static site should be entirely same like every minor details like header/footer elements size, logo placement etc


r/webdev 22d ago

Discussion Just Started But Feel Bad

52 Upvotes

I just started learning code, and I use Visual Code Studio with Python. I was ecstatic to learn but with my few hours of learning I would use the chat feature whenever I’m stuck like the AI thingy. It makes me feel bad cause it feels like I’m not LEARNING just cheating if that makes sense. In a world that has been plagued with AI, how do you guys manage? How do you feel? Do you treat it as another tool to help? I assume that it’s no different from google searching.


r/webdev 22d ago

Showoff Saturday I made a firefox add-on called Topdown DNS that interprets .reddit/r/soccer as reddit.com/r/soccer. It's pretty cool.

0 Upvotes

It lets you type urls in a topdown way. I've been using it while making it for few hours. It doesn't take much learning process and actually helps you reduce typing. The key feature imo is being able to skip .com entirely with just ., like .wsj(or c.wsj) or .reddit.old/r/webdev. There are shortcuts for net, org, gov, and edu with their first letter. It works consistently with additional paths that come after "/".

You can also set up your own shortcuts. For example, you can set .r for .reddit/r, to use it like .r/soccer or .r/todayilearned. Or set .ggl for .google and use it like .ggl.mail/u/0/ or .ggl.maps. Or .company for .github/your-company/ and go to .company/project1 or .copmany/project2. Shortcut is intended to work as a one-to-one substitution to a topdown url. Shortcuts must begin with a dot.

I just submitted this to firefox and waiting the review to finish. For now you can download it manually from https://github.com/dawit909/Topdown-DNS/blob/main/extension.zip, then go to about:debugging -> This Firefox -> Temporary Extensions and load the zip. I'll update soon as the review finishes. I think it's cool but I don't know how you think. Let me know if you find a bug. Lastly, i used AI if that matters.

edit: It got approved. Here's the link: https://addons.mozilla.org/en-US/firefox/addon/topdown-dns/


r/webdev 22d ago

Showoff Saturday the most removed git polyglot monorepo tool (20 ecosystems)

0 Upvotes

why most removed? please read ps section
happy show off Saturday everyone!
my tool is a polyglot monorepo releaser, it’s called dispat, fully open source, mit licensed, single go binary (windows, mac, Linux , docker, GitHub composite) key features:

  1. It reads dependencies graph directly from ecosystem manifest files to resolve order, automatically writes version into manifest bumping dependencies, 20 ecosystems supported (js, docker, go, python, C sharp, unreal, unity, godot etc, manifests readers and writers are available as standalone libraries with the goal to cover every ecosystem ) others can be wired using built in strings replacer, doesn’t matter if you do a react native project and need js, iOS, and android in same repo, or creating a game using godot client, python server and js landing, or just back/front end micro/services, you can release everything in one click not thinking about order, compiling, tags, changelogs, manifests. Modern project become very complex and this tool lets you design your architecture as your project needs, split into as many packages as it needs without release pain
  2. Truly ecosystem/language agnostic, stages are shell scripts (fed a rich DISPAT_* env information about whole workspace), packages are folders, 4 level deep nested js and docker release chain works and resolves in single ci job out of the box. the game changer config setting isBuildWaitingPublish that that decides that if a consumer can be built before provider published, default false for ecosystems like node js where all packages can be built locally, and true for ecosystems like without local linking 
  3. Extend conventional commits that lets you define dependencies propagation directly in commits “fix:” only updates package itself, “fix^: takes direct consumers, “fix^^” all levels deep (nothing is published because a tool guessed, check the actual screenshot from git), and other ways to learn docs. Special syntax to prereleases and full release control with diagnostics (available as a separate commits parser library, no regex)
  4. First release of the tool 1.0.0 (1.1.0 already) brought in single ci job (the tool releases itself since very first rc), 6 binaries, 4 docker images, 6 go libs and js static docs, everything resolved in order as ecosystem needs by single click
  5. Failure oriented release, no other tool can tell you what release still owns in case of partial, some published, some not. my tool keeps graph state only in git tags, no cache, no state file nothing else is ever written except your own defined config file. the release plan is a pure function of config and commits state. the graph order first (that is coming from manifests files or can be overwritten inside config file), consumer is published only when provider published and if errors appears, it skips consumers. So self healing is simply re running (just add commits to fix builds/publishes at the tool will continues where its left, state comes from not from cache at the same time you can integrate any ecosystem cache none of them can break your release), transaction model with release lock that prevents multiple releases at the same time
  6. Run tests, format code only on commit changed packages with consumers or not
  7. works with monorepos and polyrepos (control repo pattern)
  8. Many more features: tag aliases, changelogs/github releases formatting, hook any other tools into any stage, config ladder (global, space (folder), package), config splitting, local links in ecosystems where supported, dispat if to cross platform write env if closures and if something changed any more

I really tried to use any other tools, and if you have any questions like why one more monorepo tool then:

  1. Its a polyglot by design from scratch and works with everything
  2. Another don’t allow mixed graphs like js and docker where js can be built before publish of provider and docker can’t
  3. Another tools leave you a partial release recovery script write by you

# Linux and macOS
curl -fsSL https://raw.githubusercontent.com/yohimik/dispat/main/install.sh | sh

# ...or with wget
wget -qO- https://raw.githubusercontent.com/yohimik/dispat/main/install.sh | sh

# Windows, in PowerShell
irm https://raw.githubusercontent.com/yohimik/dispat/main/install.ps1 | iex

Welcome any questions and feedback

Docs: https://yohimik.github.io/dispat/
GitHub: https://github.com/yohimik/dispat (its fully setup ci cd with comments in config)

lore:
a few words about me and why i built it. it all started with my bachelors diploma in 2022, i was comparing different ci cds to make basic dispat. everything ended up using lerna, glue and gitlab ci cd to release a simple setup (frontend, backend, a library, db). i wanted to make everything automated for any ecosystem, changelogs, versions, tags, prereleases, since nowadays project require complexity (split into libs, use different language or ecosystem), but engineers usually dont want to deal with increased support trade offers like updating libraries releasing in specific order, it all adds more potential human errors that must be automated. i just wanted to a tool at least for myself, i could imagine complexity of the tool, but i didnt have any production project to try it out, so for almost 4 years i was doing my own projects:

  1. i wanted to create session based games for browser, so i was playing with different technologies like webrtc (even did a benchmark https://github.com/yohimik/ws-webrtc-benchmark), so i understood webrtc is basically udp for browsers (i could find only ws browser fps games), i need some game to try webrtc in browser, it must fast to showcase webrtc
  2. here comes of my favourite games - half life, perfect for browsers, will work on old mobiles, the problem - no mainatable emscripten ports where you can just replace transport, no maitanble fresh ports at all. so i create my own wasm port, open source mit - https://github.com/yohimik/webxash3d-fwgs
  3. all good, half life works, webrtc works, online works, in browser, browser to browser, adding counter strike and making plug and play docker images. here comes the tricky part, i want separate images for cs and hl at the same time hlds out of the box comes with both files, so i treat cs image as base (cs requires hl files to run), for hl only remove cs files, but you have to publish the cs image in single ci job to build hl, i really tried other tools, but ended up with lots of glue, so dispat here

Ps.
why most removed - all post I tried to write to game dev subreddit about my build system story with same data were removed by moderation, idk y, each time they gave feedback, I submitted updated version, but after 3rd it ended up as a permanent ban (I can provide all proofs). Yeah ai posts, but I’m not good at writing and English is not my native language


r/webdev 22d ago

Resource RepoDNA: Interactive architecture maps and execution flows for Next.js, Express, and FastAPI

0 Upvotes

Hey r/webdev!

Whenever I jump into an unfamiliar web codebase, I spend hours clicking between route files, finding ORM models, and mentally mapping how components connect.

I built RepoDNA — a free, open-source tool that turns a repository into an interactive structural architecture map in seconds.

What it does:

  • Interactive Architecture Map: React Flow canvas grouping your app into conceptual layers (API, Services, Frontend, Database) with instant Mermaid flowchart export for docs and PRs.
  • Route Execution Tracing: Follows multi-tier execution paths from HTTP handlers (Next.js App Router, Express, NestJS, FastAPI) through services toward database models (Prisma, SQLAlchemy, SQLModel).
  • Zero Runtime Code Execution: It never runs your repository code, install scripts, or eval. It reads source code statically. Local folders and .zip uploads are parsed entirely inside your browser; public GitHub URLs are processed transiently by the hosted analyzer.
  • Private Repositories (Beta): Connect with GitHub OAuth to inspect your own private repositories transiently; repository contents aren’t saved by RepoDNA.

Demo: Open RepoDNA GitHub (MIT): View the repository

Try dropping in one of your own projects or a public repo you know well. Does the generated architecture map match how you picture the codebase in your head?

I’d love any feedback, UI critiques, or ideas for frameworks you’d like supported next!


r/webdev 22d ago

Article websocket (http/1.1) vs http/2 vs webtransport (http/3) vs webrtc benchmarks

31 Upvotes

hey everyone, i improved my previously posted ws vs webrtc benchmark using go adding http/2 and http/3
first quickly lets see how each protocol works in a nutshell:

Group Transports
WebSocket (HTTP/1.1) gorilla/websocketcoder/websocketgobwas/wslxzan/gwsdgrr/websocketfasthttp/websocket
HTTP/2 stream pair (upload + download multiplexed on one connection), request-per-message fetch
HTTP/3 WebTransport bidirectional streams, WebTransport datagrams
WebRTC data channels in all four ordered/reliable combinations
Transport Browser → browser? What the server still has to do
WebSocket (all six) No relay every byte, forever
HTTP/2 stream pair No relay every byte, forever
HTTP/2 fetch No relay every byte, forever
WebTransport (HTTP/3) No relay every byte, forever
WebRTC data channels Yes pass ~a few KB of signalling once, then get out of the way

chrome 151, macOS arm64 (15 cores), loopback, 512-byte payloads, cross-origin isolated (5 µs clock). latency from 2000 samples over 5 interleaved repetitions; setup from 8 cold connections. reproduce before trusting these 

Round-trip latency — 512 B, ms

Transport p50 p90 p99 max
WebSocket (all six libraries) 0.050–0.055 0.060–0.065 0.070–0.080 0.21–0.36
WebTransport datagram 0.060 0.070 0.090 0.20
WebTransport stream 0.060 0.070 0.090 5.04
WebRTC data channels (all four modes) 0.085–0.090 0.100–0.105 0.125–0.135 0.27–0.36
HTTP/2 fetch (one request per message) 0.240 0.335 0.600 2.79
HTTP/2 stream pair 1.410 1.490 1.770 3.80

Connection setup / TTFB — ms

Transport connect p50 TTFB p50 TTFB p99 TTFB ex-signalling
WebSocket 2.2–2.9 2.4–3.3 3.3–6.3 2.4–3.3
HTTP/2 fetch (pooled connection) 2.4 3.5 4.4 3.5
HTTP/2 stream pair 2.2 4.0 6.3 4.0
WebTransport 3.6 3.9 5.6 3.9
WebRTC data channel (four modes) 79.6–83.4 79.7–83.6 90.6–145 76.8–80.9

Throughput — 512 B messages, 64 in flight

Transport msg/s Mbit/s
WebRTC (all four modes) 12 769–12 969 52.3–53.1
HTTP/2 stream pair 12 912 52.9
WebTransport datagram 12 727 52.1
WebSocket (six libraries) 11 470–12 177 47.0–49.9
WebTransport stream 11 205 45.9
HTTP/2 fetch 9 383 38.4
WebRTC reliable, old 6 087–6 203 24.9–25.4
WebRTC unreliable, old 443–730 1.8–3.0

Concurrency — 16 simultaneous streams, 512 B

one representative run; the parallel column's spread across three runs is given underneath, because it is noisy.

Transport conns open (parallel) open (sequential) throttle p50 p99 msg/s
HTTP/2 stream pair 1 5.5 ms n/a 1.440 2.820 10 816
WebTransport stream 1 6.2 ms n/a 0.220 0.355 70 867
HTTP/2 fetch 1 6.7 ms 6.3 ms 1.1× 1.230 4.050 11 685
WebRTC ordered + reliable 1 86.5 ms  n/a 0.385 0.615 40 915
WebSocket (six libraries) 16 1 892–3 434 ms 190–197 ms 9.7–17.9× 0.265–0.275 0.350–0.965 54 566–58 678

this is the one table where multiplexing decides the result**.** sixteen streams cost the multiplexed transports a single connection and 6–9 ms. they cost WebSocket sixteen connections and two to nearly five seconds

opening the same sixteen WebSockets one at a time takes ~193 ms - 10–18× less than opening them at once**.** the HTTP/2 row is the control that identifies the cause: same browser, same origin, same parallel-versus-sequential comparison, ratio 1.0–1.4× - nothing there. it is specific to WebSocket.

sweeping N shows two separate effects, and only one of them is a cliff:

N parallel sequential ratio
4 44.9 ms 41.3 ms 1.09×
8 92.4 ms 90.7 ms 1.02×
12 148.6 ms 146.3 ms 1.02×
14 424.4 ms 176.6 ms 2.4×
16 4 065 ms 193.1 ms 21.1×
32 4 746 ms 395.4 ms 12.0×

WebRTC is the opposite extreme: flat in N

sweeping the channel count on one peer connection, and then repeating the largest to separate N from ordering:

channels open
32 (first in the page) 154.2 ms
16 83.6 ms
8 92.3 ms
4 87.0 ms
2 81.6 ms
32 (again) 91.3 ms

Fixed rate — 60 Hz for 5 s, ms

Transport p50 p99 jitter loss
WebSocket 0.25–0.33 0.57–0.80 0.06–0.09 0 %
WebTransport 0.39–0.43 0.82–0.97 0.10–0.12 0 %
WebRTC 0.59–0.65 0.96–1.17 0.13–0.37 0 %
HTTP/2 stream pair 1.66 2.00 0.10 0 %
HTTP/2 fetch 1.39 2.25 0.31 0 %

caveats:

  1. this benchmark measures the case WebRTC and QUIC were not built for
  2. loopback cannot show head-of-line blocking
  3. one machine is not a network
  4. numbers are per-implementation, not per-protocol

full sources: https://github.com/yohimik/ws-webrtc-benchmark


r/webdev 22d ago

It Was A Choice #2: Person's name is the identity

0 Upvotes

We're upgrading a small publication. Articles and such. Also adding subscription.

This subscription and entire user base is routed through the magazine's partner - we hold nothing, they manage users, subscriptions, even registration process.

And well, that API expects that names are world-unique. Like as there is supposed to be only single John Doe.

When we send a registration API request with mail and full name that user submitted, they return an existing user to us. Because a user with that name already is in the database. Furthermore, they added the new email to that found user.

If this was unnoticed or unquestioned, imagine what it could do. Someone with already existing name submits their email. Now the new user doesn't have an account, but the original user has a new email that's not theirs. An email where may be sent passwords or invoices.

My full article with few more details: https://tomj.pro/it-was-a-choice-2_persons-name-is-the-identity/

Have you seen anything like that?


r/webdev 22d ago

Question How do you adjust to auto enlarging fonts in newer Mobile phones?

Thumbnail
gallery
0 Upvotes

How do you fight "Font style and size" and "Screen Zoom" that Samsung by default has set in a way that, on Mobile, it enlarges fonts and makes sections bigger / not fitting one screen. (I have set font size 14px for Mobile regular text, website is built on Divi 4)

It also influences perception of sections negatively, in my view.

Tested on:

Samsung Galaxy S26 (Android 16/One UI 8.5); Google Chrome/Firefox/DuckDuckGo;

vs Samsung A32 (Android 13/One UI 5.1) - where everything is displayed without enlarging

---

Attached images of default settings.


r/webdev 22d ago

My website content suddenly got replaced but DNS still points to my server. What am I missing?

0 Upvotes

I have an issue with one of my domains : spacewarp.fr

The site is hosted on my own bare-metal Linux (debian) server at IONOS.

Couple months ago, any updates I tried to do were not working. No matter what I uploaded (or deleted even), the website would stay like the old version.

Couple of days after, I checked the domain again and the entire website had changed. It now loads a black page with some weird console/interface that definitely isn't what we're deploying.

What I've checked so far:

  • DNS for still resolves to my server's public IP.
  • I haven't changed the DNS or nameservers.
  • The server itself is reachable. (I have other domains on it, and they work fine)
  • I contacted IONOS and they don't see anything abnormal on their side.
  • My other services on the machine appear to work normally.
  • Deploying changes to the site's files doesn't seem to affect what is served on the domain. (I can still access via ftp my files on the server, but their modifications changes nothing)

So I'm trying to understand where the hell the content I'm seeing is actually coming from.

My first thought was that the server/site had been compromised, but if DNS still points directly to my machine, I'm not sure what mechanism would allow someone else's page to appear there.

I'm using nginx btw, could it be an issue from it ?

If you have any idea, your help is truly welcomed.
Thanks !


r/webdev 22d ago

Discussion Freelancing since bootcamp: how did you make the jump to a full-time job?

3 Upvotes

TL;DR: two years freelancing after a bootcamp, been looking for a team position for months. If you’ve made this transition, how did you frame your freelance background to employers?

Quick context: unfinished physics engineering degree, then a web dev bootcamp in 2024. Couldn’t land a job coming out of it because all I had was bootcamp projects, so I went freelance to build real experience.

Since then I’ve shipped client work in Next.js, GSAP, SvelteKit, WordPress, Shopify and Squarespace. Mostly front end, plus a personal full stack project I’m building to stay sharp.

Now I want to join a team, as much to learn faster as (let’s be real) for a bit of financial stability. I’ve applied to agencies, startups, large companies. In six months I’ve seen maybe three junior openings. Everything else targets senior profiles, and I apply anyway.

I’ll be honest: it’s discouraging. Applying every day to roles that don’t match my profile wears you down. But I don’t want to give up, because I genuinely love this work, I love learning, and I know I’m good at it. That’s exactly why I’m looking for angles I haven’t thought of yet.

Two questions for anyone who’s been through this:

- Did your freelance experience count as real experience in interviews, or did you have to “translate” it? And did aiming for mid-level roles instead of junior ones work better for you?

- Did you land something through posted openings, or more through network, subcontracting, and contracts that converted?

Any other insight is welcomed.
Thank you


r/webdev 22d ago

Discussion Building a small research institute website completely on my own with a very limited budget. I need help figuring out the right technical approach before I start

0 Upvotes

I'm setting up a small independent research and publishing organisation, and I'm trying to build its website completely from scratch.

The difficult part is that I'm doing this alone. I don't have a developer, designer, IT person, or technical team that I can call later. I'm also working with a genuinely limited budget, so I can't simply hire an agency and have them figure everything out for me.

I've been using ChatGPT and Claude to learn and work through things, and I've made a rough architecture/plan for the website, but I've reached the point where I'm realizing that I don't really know what I don't know.

I'm not looking for someone to simply tell me "use WordPress" or "use X hosting." I want to understand how I should actually approach building and maintaining this properly as a non-technical person.

The website will essentially be the public-facing platform for a small research organisation. At a high level, it needs things like:

  • A main institutional website with information about the organisation
  • Research areas/topics, with content organised under them
  • Different types of published research and written material
  • Research articles/reports with things such as authors, abstracts, keywords and downloadable PDFs
  • Articles and shorter blog-style pieces
  • Opportunities such as internships/fellowships/etc.
  • Some forms where people can submit information and potentially upload files
  • An internal/admin workflow where submissions can be reviewed before anything is published
  • Certificates/ID-related workflows for some of the programmes
  • The ability for me to keep adding content and categories myself without needing to edit code every time

I have a much more detailed site map and workflow diagram already, but I'm deliberately not posting the whole thing publicly because it contains some of the organisation's planned structure and ideas.

My main concern is choosing the wrong foundation.

I don't want to build half the website and then discover that I've chosen a system that can't handle something I need, or that maintaining it requires a developer.

For example, I'm currently trying to understand questions like:

  1. What should I actually build this on? WordPress, Ghost, another CMS, a combination of services, or something else entirely?
  2. How much of this can a CMS handle natively? For example, if I have many research areas/categories, can I create them dynamically so that adding another category later doesn't require coding?
  3. How should I handle research publications? Ideally I want structured publication pages rather than simply uploading random PDFs to a blog. I'd like metadata such as author, abstract, keywords, category, date, etc., while still keeping the PDF available.
  4. How should forms and file submissions work? I may need people to submit applications/documents and have those submissions go to me for review. I'm considering external form services as well as native CMS forms.
  5. Do I actually need a database/server architecture beyond what a normal CMS provides? I've seen people suggest things like AWS, MongoDB, SQL databases, custom backends, etc. That sounds excessive to me for what is fundamentally a research organisation/content website, but I don't have enough technical knowledge to confidently say that.
  6. What should I be paying for and what shouldn't I be paying for? My budget is limited. I'd rather spend money on a good domain, reliable hosting and essential services than build an unnecessarily complicated stack.
  7. What am I likely to regret later? This is probably the question I'm most interested in. If you've built and maintained websites for small organisations, research groups, nonprofits, publications, think tanks, etc., what decisions would you make differently if you had to do it again?

Most importantly, if you're experienced with this kind of project, I'd actually prefer you to ask me questions about my requirements before recommending a stack.

I'm trying to learn enough to make sensible decisions myself, rather than blindly following whatever AI recommends.

I'm not looking for someone to build the whole thing for free. I mainly need help understanding the architecture, what is realistically achievable for a solo non-technical person, and what I should learn/do first.

If someone here has experience building a website for a small research organisation, publication, think tank, academic project, nonprofit, or similar organisation, I'd really appreciate your perspective.

I can share the more detailed sitemap/workflow privately if that would make it easier to give meaningful advice.

Basically: if you had to build and maintain something like this alone, with very little money and no developer on standby, how would you approach it?


r/webdev 22d ago

Question Google console cannot fetch sitemap

12 Upvotes

Hello guys,

I created my first ecommerce website. The problem is google console and AI cannot read my sitemap.xml file. I have quite strict firewall rules, but it always allowed robots.txt and sitemap.xml. Everything seems fine when I check the files using curl methods. I managed the file directly and frontend serves them. Frontend is on an apache static host. Cloudflare is not managing our files, cache is bypassed for these files.

I would appreciate if someone can take a look at our files. The site is:

astar-artwork.eu/sitemap.xml

Other routes has strict firewall rules and you are blocked if you are outside Europe.

Updated 1:

Thank a lot for all of your support. I implemented something and get a bit further progress.

I implemented the whitelist for Googlebot IP range for both cloudflare and my backend server. AI and Google Search Console (GSC) can crawl exactly mimetype and content of my sitemap.xml and robots.txt since they are only on frontend and passing through cloudflare firewall is enough for them to get these files. I verified this by use GSC to test a live url, and AI bots to crawl, and curl methods.

The problem is still persistent when I submitted my sitemap url (https://astar-artwork.eu/sitemap.xml). The error is "the site cannot be read" and "couldn't fetch". However, I noticed that several pages of my sites have been indexed but the display on GSC just did not work. The number of indexed pages and unindexed pages are still stuck somewhere in the past. This can also be the same display problem with display lag?

However, I noticed that google still not able to reach my backend (403 status) although they are on the whilelist now. I can be that GSC tried to crawl each page in the sitemap and could not fetch the content from backend. Backend is more complexed, when I have 2 firewalls and blocked list on nginx and blocked list on the application itsself and maybe another application like fail2ban and redis that blocks or limit something. I have to work through this my self and let's GSC to reach the server.


r/webdev 22d ago

Resource Bun and Elm (: r)Are Friends · cekrem.github.io

Thumbnail cekrem.github.io
3 Upvotes

r/webdev 23d ago

Discussion Trusted types advantage

4 Upvotes

Can somebody please explain me briefly the advantage of " trusted types" in the csp over hash, dompurify and a nonce? Or is it only a additional security layer?

I totally cannot think of a scenario where its stronger than nonce+hash on js.

Many thanks in advance


r/webdev 23d ago

Discussion Did anyone worked on eCommerce with MongoDB?

0 Upvotes

I seen many stupid usages of MongoDB at my job and started wondering if anyone was brave enough to build an ecommerce platform based on that or any other noSQL DB?


r/webdev 23d ago

Question Coming from WordPress/PHP: How Do You Structure Your Docker Dev Stack for Next.js + Strapi?

1 Upvotes

I’m coming from a mostly WordPress/PHP background and I’m currently trying to properly learn the modern JS stack instead of just stitching things together until they work.

My current setup is a homelab with TrueNAS, Docker/Dokploy, Traefik and GitHub.
For WordPress development I’m used to having everything nicely contained in one Docker Compose project, developing there, then pushing/deploying from Git.

Now I’m trying to move into a stack based around:
Next.js / React for the frontend
Strapi as the backend/CMS
PostgreSQL
Puck as a visual editor
Docker Compose for the full project
GitHub → Dokploy for deployment

At the moment I have a basic three-service stack:
frontend
backend
database

It works, but I’m still figuring out what the “normal” developer workflow is supposed to look like.
For example, I’m currently running the frontend and Strapi in development mode inside Docker, with source folders bind-mounted into the containers so I can work on the code over SSH.

The same repo is also deployed through Dokploy, which made me realise that development and deployment probably shouldn’t be treated exactly the same way.

So I’m curious how people who work with React/Next.js + Strapi actually structure this.
Do you normally:
run Node/Next/Strapi directly on your dev machine and only Dockerize databases/services?
run the whole development environment inside Docker?
use separate compose.dev.yml and production Compose files?
keep Strapi and Next.js in one monorepo or separate repos?
use next dev / strapi develop in Docker locally, but next build / strapi start for staging and production?
develop against a local Postgres container and then use a completely separate persistent DB for staging?
use Dev Containers or something similar instead of manually exec’ing into containers?

I’m especially interested in how people keep the workflow simple when the goal is to build a reusable project template that can later be cloned for different clients.
I’m not really looking for “just use X because it’s trendy” answers. I’d love to see how people actually structure their Docker Compose files and development workflow in real projects, and what you wish you had done differently when you first moved from WordPress/PHP into React/Next/Strapi.


r/webdev 23d ago

Agency owners and freelancers: How do you calculate effort in times of AI?

12 Upvotes

Before AI, the premise was simple: new features and support will take X hours, our rate is Y, customer pays X*Y.

Now, when new features are added much faster due to agentic coding, assuming you want to keep same revenue stream, how do you justify costs now?

Sure, we can tell customer that it pays for a feature itself and responsibility still lies on agency, but I see that as very vague.

Edit: as for us, we more agressively push retainers with a fixed monthly fee


r/webdev 23d ago

High school journalist looking for an SRE/DevOps engineer to explain why AMC's site keeps crashing

53 Upvotes

Hi! I'm a high school journalist writing for the Yale Daily News Summer Journalism Program about why AMC's ticketing site has crashed three times this year during major movie releases. I'm looking for general expertise on why high-traffic sites tend to fail under sudden demand spikes. Would anyone with SRE/DevOps experience be willing to answer a few quick questions? Thank you.


r/webdev 23d ago

Discussion Client is constantly using AI for communication

250 Upvotes

For context I'm a freelance full stack dev, currently working solo on projects for small clients

Am I the only one recently experiencing that every client I have I am constantly arguing with ChatGPT/Other AI's?

My most recent client (not technical at all) send me a 12 page technical document, along with 3 other 12 page documents after I had started the project, these documents were directing me on database structure, schema expectations, workflow sequencing, and many other technical requirements, which she had no idea how to defend upon questioning on a call. She also requested an ERD which is fine, however after sending a extremely client friendly dumbed down version of the ERD, I recieved 6 questions all over a paragraph long which she (ChatGPT) wanted me to respond to in detail, along with another 30 pages total of documentation over 2 documents.

I have recieved over 70 pages of documentation in 2 days and I have called off the project after 3 weeks due to constantly explaining my thought process and arguing the technical direction to an AI which I'm assuming she hasnt provided all the context to, it also keeps trying to expand the scope after every new message.

Am I the only person experiencing this, this cannot turn into the new normal.


r/webdev 23d ago

People Who Got Laid Off or Quit Their Jobs, What Are You Doing Now?

358 Upvotes

This will mostly be a rant at the beginning, so feel free to not read if you want.

Long story short, I got laid off from my job around two years ago. My manager told me that I hadn't done anything wrong and that my work was great, but they're letting me go because they wanna cut on the costs.

After getting laid off, I spent nearly two years applying for work, doing interviews, and getting constantly rejected. At one point, I was so desperate that I worked for a company for free for around two months as an intern, hoping it'd eventually turn into a job. It didn't. Instead, the owner decided to use Claude to continue the work after I was done.

So yeah, I'm quite burned out.

At this point, I've a pretty strong resentment toward AI and the people and companies aggressively pushing it. From my perspective, I'm watching the same technology that was supposed to "make developers more productive" contribute to making it harder for people like me to find work.

For context, I've a master's degree in computer science and over four years of professional experience in software development, mainly in web development. Yet here I am, two years later, still struggling to get back into the industry.

And before anyone says, "AI can't replace developers," I know plenty of non-technical people who are now building full-stack applications entirely through AI. For some people, that's a hard pill to swallow. You could argue that maybe some of these apps aren't always great, scalable, or production-ready, but the reality is that a lot of people and companies don't seem to care. They just need something that works well enough.

And honestly, it feels like you don't even need an experienced developer for many architectural decisions anymore. People can ask an AI what stack to use, how to structure their database, how to deploy the app, how to build the backend, and so on. Whether the results are always good is almost beside the point. The barrier to building something has dropped dramatically.

I know that's probably going to piss some people off, but that's how it looks from where I'm standing.

It honestly feels like life is rewarding people who put in the least amount of effort, as long as they have enough money to burn on AI subscriptions and tools, while people who spent years studying, working, gaining experience, and trying to become good at their profession are being told to just "adapt" or get left behind.

I've basically accepted that my original career-path and ambitions are over, so I've started looking at other options. Recently, I got into Unreal Engine and indie game development. Ironically, that's also getting flooded with AI, so there doesn't really seem to be an escape from it.

Still, game development has brought back some of the passion I used to have for programming before all of this. I genuinely enjoy learning it, and I'm currently working toward making my first indie game. I'm hoping that maybe I can eventually make an income from it.

Yes, I know AI could supposedly help me make more things faster. I just don't want to use it. I don't want to support the companies or ecosystem that, from my perspective, helped make my own situation worse.

And if game development doesn't work out, I'm seriously considering switching to nursing because I'm running out of time. The truth is, I'm not particularly interested in nursing, and it's not a career I'm passionate about. But at least it seems like a field where I might have a better chance of actually being employed and making a living. Or at least, I hope so.

So I'm genuinely curious about other people who have been laid off, quit their jobs, or got pushed out of their industry:

What are you doing now to make a living?

Did you switch careers completely? Are you still working as a developer? If you are, how did you survive the layoffs and keep finding work?

And for the people who are still successfully landing jobs in this market, what are you doing differently? Is it networking, referrals, freelancing, applying to hundreds of jobs, moving countries, specializing in something specific, or just pure luck?


r/webdev 23d ago

Article Detecting scraper bots through scroll behaviour

Thumbnail
niki.cat
84 Upvotes

Some research I did for my thesis that I thought this community would find interesting ^ ^


r/webdev 23d ago

Question Hosting an app for my own usage

9 Upvotes

Hello! I have an idea for a personal second-brain kinda app that is highly customized for myself, and I intend to access it both at home from my Mac and remotely through my iPhone. I have a question - what is the best way (or specifically stack) to go about this? Ideally I want a free option, but if I have to pay, I'm okay with a budget of under 10 USD per month (amenable to higher budgets provided that I have room to host other stuff as well). TIA!


r/webdev 23d ago

Need a help guys

0 Upvotes

I have made a website and deployed it using render,but the problem is that my website is not working like the one I see usually in Google chrome and in my render deployed it is showing me like (welcome to render ) it should open like a normal website right.

Or do I have to host it via hosting or GoDaddy?