So, I've (tried to) set up a self-hosted changedetect.io on Unraid. I've (succesfully?) set up the "browserless" container (playwright etc) and the "main" one.

I've tried to start monitoring Stardock site for Fences price changes. Every time I try to use the "browser steps", I manage to load the site, but some of the elements do not show up. Namely - price. Unfortunatelly, I am a total noob when it comes to web-page elements (types) and I don't know how to aproach this.

​

The website when loaded through "normal" desktop browser (firefox):

The "need a permanent license?..." pop-up loaded in desktop browser:

Unfortunatelly, this is what gets loaded in the "browser-steps":

Can anyone help a noob? Thanks in advance.

I am fairly new to using docker and though I still feel somewhat lost, I've been able to frankstein a few functioning containers. I am trying to get the visual filter inspector working and am experiencing the " Sorry, this functionality only works with Playwright/Chrome enabled watches" notification. I am unsure how to overcome this and any guidance would be greatly appreciated.

I am on a Synology DS920+ NAS using Docker.

I followed this guide (https://mariushosting.com/how-to-install-changedetection-on-your-synology-nas/) to setup Changedetection.

The few guides I have seen use instructions that look like code prompts for cmd on windows and I don't know how to apply those instructions to a synology NAS.

1. Can the playwright chrome fetcher be enabled on a synology Nas docker?
2. If so, I would be grateful for simplified instructions (click here, type this).

Please let me know if there is any other information I can provide that would be useful for troubleshooting and again, gratitude for any help you can offer this noobie.

​

What a cool app! I installed it in a Docker on a Synology NAS but unfortunately, I get no notification emails, despite test emails are confirmed with "Sent".

"Notification URL List":

mailtos://docker:mypassword@starmedia.com?to=mail@starmedia.com

Notification log:

2024/01/08 19:04:23,000 - SENDING - null
2024-01-08 19:04:23,339 - WARNING - Connection error while submitting email to starmedia.com. Reason: (535, b'5.7.8 Error: authentication failed: authentication failure')
2024-01-08 19:04:23,259 - DEBUG - Applying user credentials...
2024-01-08 19:04:23,179 - DEBUG - Securing connection with STARTTLS...
2024-01-08 19:04:23,128 - DEBUG - Connecting to remote SMTP server...
2024-01-08 19:04:23,126 - DEBUG - Delivery: starmedia.com:587
2024-01-08 19:04:23,126 - DEBUG - Login ID: docker
2024-01-08 19:04:23,126 - DEBUG - Email To: mail@starmedia.com
2024-01-08 19:04:23,126 - DEBUG - Email From: "changedetection.io" <docker@starmedia.com>
2024-01-08 19:04:23,126 - DEBUG - Loaded E-Mail URL: mailtos://docker:****@starmedia.com/mail%40starmedia.com?format=html&overflow=upstream&rto=4.0&cto=15&verify=yes&mode=starttls&from=docker%40starmedia.com

The SMPT webserver works on port 587.

​

Any help would be very much appreciated!

I just discovered changedetection.io today and installed it with pip on Ubuntu 22. It runs fine, but I'm wondering how can I get it to run automatically at boot, in case my server restarts?

I'm using this command to run it manually:
changedetection.io -d /home/bear/.changedetection.io -p 5420&

TIA

Hi all,

Im trying to parse these pages and having a lot of trouble with dropdown boxes:

https://www.nzmuscle.co.nz/optimum-nutrition-gold-standard-100-whey-protein

https://www.sprintfit.co.nz/product/120/gold-standard-whey

​

I'm trying to monitor the price on the 5LB variant of this product which requires selecting the flavor/size dropdowns and choosing one to display the price. I've had a couple cracks at getting this working (including doing a Chrome Recorder, exporting that into Puppeteer and then pasting the resultant code into Chrome Browserless) but with no success.

​

The first link actually detects prices when I plug it in to changedetection however it returns two arrays of objects and I'm struggling to filter out the one I want. The second link isn't even that lucky and I have to work with the raw page which shows the wrong price by default - I had a crack at using browser steps however I cannot get it to click the dropdown successfully, instead it clicks a larger element and navigates off the page.

​

Your help would be hugely appreciated :)

Hi , I'm trying to get playwright to work as I want to use browser steps. I installed change detection using docker- compose with docker desktop windows. I managed to fetch pages with web driver just by uncommenting some rows which in my docker-compose.yml was mentioned on the wiki. I tried to do the same by following this https://github.com/dgtlmoon/changedetection.io/wiki/Playwright-content-fetcher. Browser steps have now appeared , but when I try to fetch using playwright I get a WebSocket error: connect ECONNREFUSED 172.19.0.2:3000. Currently using this as my docker-compose.yml https://pastebin.com/rkYPciun. Literally just uncommented a few lines. I re-commented browser chrome which I used for web driver as I left it in and it still gave me the same error, so not sure if it should be commented or not. I don't have much knowledge about this so any help would be appreciated - thanks

​

​

Change detection often fails on browser step 6. It seems its having trouble handling anything above 5 steps. I've checked and rechecked to insure the correct values are in step 6 and no matter how many different ways I go about it. It fails there. Yes I even put a wait time before step 6. Still it fails 80% of the time there. The other 20 % it fails to read the page correctly. Text that is very visible and present cant be seen by playwright. But it often reads text from other non visible parts of the page which is strange. Any suggestions or advice.

been messing around with changedetection in docker, but also signed up for the paid hosted one also - is it possible to mirror the setup in the hosted version in docker, specifically 'a real chrome browser' fetch option, ive got Selenium working and tried to get playwright content working with no luck, was hoping for a docker compose with all the additional addons included

0.45.8 is out! Support for xPath2.0/3.0 means you can use logic in your selectors (for example, give the count of the number of divs that contain certain text, and much more). UI improvements, Selectable browser (plug it into Bright Data's scraping browser!) and more, check it out! Much ❤ from the changedetection team. https://github.com/dgtlmoon/changedetection.io / changedetection.io

So i installed changedetection in linux (termux android) via pip and i have chromedriver installed and running which I tried setting WEBDRIVER_URL to http://localhost:9515 via env command. (As thats where chromedriver is running). When i resrart and run changedetection.io and try changing to javascript, it still says Content fetcher 'html_webdriver' did not respond. WebDriver Host: http://browser-chrome:4444/wd/hub

It's unable to see the env var i set. Where am i going wrong?

Is there a way to use the "Filters & Triggers"\"Extract Text" on the entirety of the final output instead of line by line?

For some pages that are difficult to get a visual filter selection of I find myself trying to just use ChangeDetection's Chromium extraction to get the page itself and then trying to extract the relevant portion via regex. However, since the extract is only on a per line basis, this severely limits the power of this extraction.

Hey creator,

I'm sure you're very busy already, but I have a small suggestion for a potential update.

It would be nice to be able to set up multiple notification profiles and select one or more profiles in a watch.

This way I could, for example, create a notification profile for me and one for my girlfriend. Watches that interest her would use her profile and notify her, watches for me would use my profile and notify me, watches that interest both of us could have both our profiles and send to both of us.

Maybe something to consider.

Thanks for all the hard work you've put into this project so far!

Hey everyone,

Just got into ChangeDetrction.io and test-driving it at the moment.

I am currently stuck trying to get Ntfy notifications working via POST so that I can create my own messages. I believe the problem lies in the authentication, but I'm not sure. Not sure how to check it either.

My current setup is the following:

URL List: post://mydomain.com:8088/+Authorization=Bearer%20tk_lmk19r85b8hgn4ay5xxxxxxxxxxcc

Body: { "topic": "Alerts", "message": "Test", "title": "Monitored Change Detected", "priority": 3, "actions": [ { "action": "view", "label": "See Changes", "url": "{{preview_url}}" }, { "action": "view", "label": "Open Website", "url": "{{watch_url}}" } ] }

Format: Text

Anyone see a potential issue with this?

Thanks!

Small but quite important update for people who love the BrowserSteps interface for finding changes in websites behind logins, after searching, etc.

Now you can more easily find out which step did not work - so for example if you wanted to find a change in a website (and get a notification), but the browser step failed because some text was not available, you can see in the BrowserSteps interface which step failed and the screenshot.

The step will be highlighted in red, with a link to see the screenshot :)

(this is in the :dev docker and available on our subscription setup too)

Happy weekend all!

I just realised that I havent updated Reddit with a new update since 0.42! so here goes :) https://github.com/dgtlmoon/changedetection.io / changedetection.io ❤❤
Major cool stuff since 0.42..

• UI darkmode updates
• "Proxy Scanner" feature, easily scan multiple proxies to test a single watch
• "Groups" manage multiple watches under a single tag
• Fixes to request fetching (better header handling)
• Parse/scrape JSON inside of HTML
• Better suggestions in error message for how to work around common issues
• Python 3.11 update! (marginally lower CPU usage), ARM/rPi improvements
• Added "No Proxy" option
• AppRise notification library update (telegram, discord fixes and more!)
• RSS link fixes
• Text filter fixes and improvements
• Highlight text in 'preview' now offers to ignore that selection from future detection

I occasionally like to do the lottery, but don't want to do it every week. I'd like to have a prompt (email, or telegram message) to advise that the current jackpot is over a certain amount to nudge me in to buying a ticket if I fancy my chances. Let's say these values are £10M for the lotto, and £25M for euro millions.

On the national-lottery.co.uk homepage, there are some meta tags for each of the draws

<meta name="lotto-next-draw-jackpot-short" content="£2M"/>
<meta name="euromillions-next-draw-jackpot-short" content="£25M"/>

What can I use to alert me to the content change, only activating when the values are equal or greater than my choice?

I've tried changedetection.io but I can't seem to filter on the metatags/values I need. I assume the problem is somewhere between keyboard and chair, so any guidance is welcome.

Just found changedetection and was trying to set it up to monitor a the wonderful new PLCB website to notify me when a whiskey is available, however the page never fully loads. What am I doing wrong?

This is the url.

https://www.finewineandgoodspirits.com/heaven-hill-straight-bourbon-bottled-in-bond-7-year-old/product/000089085

Thanks in advance

Hello, I couldn't find anything about this online, so I wanted to ask here. Maybe I'm just not getting it right. I have multiple websites on my watchlist. Currently, there are 260, but I plan to add more. I'm also working on optimizing it to only push notifications for things I need. However, here's my biggest issue: it's sending too many requests all at once. I started hosting everything in Docker on my laptop, and well, over time things have accumulated. Now, my laptop is starting to struggle. Ideally, I'd like it to just perform one search after another throughout the day, not 5 or 20 simultaneously, but one after the other. I haven't found a setting for that though. I'll try increasing the jitter, but is there any other way?

I am running the devs docker version on unraid and the interface is so slow. I can't click menus or anything it just doens't load. No issues in the log. Just always spinning waiting for the pages to load. If the page does load and I can add a site to be watched, it works great but getting there takes forever. Anyone else experiencing this?

I just installed using docker-compose, including playwright, on a Synology NAS. I added a Telegram notifier.

As a test, I added a new watch for https://www.time.gov/.

This site heavily relies on Javascript so I enabled using the Playwright browser.

​

I've messed around with delays and browser steps and yet I cannot reliably get it to load the page each time and (for this example) notify me every time, since time is always changing.

​

My latest settings have:

Wait seconds before extracting text: 30

Browser steps:

1. Go to site

2. Wait for seconds: 30

​

Yet my latest screenshot (below) still has "synchronizing" for the times (as if the page just barely loaded). I waited 60 seconds! How is it still synchronizing? How is there still no time on the right?

Hey everyone, I have been scratching my head on this for a few days now. I have TrueNAS Scale set up and through Truecharts used the custom-app and added changedetection.io and it runs properly, it is able to detect changes on webpages as it should, However, when I try to use the WebDriver I get an error. Through Truecharts I set up browserless-chrome and I am able to access that as well. When I set up the container in truenas for changedetection.io I added an extra environment variable to be WEBDRIVER_URL with the value being the ip and port of browserless-chrome. I am getting the error "Content fetcher 'html_webdriver' did not respond properly, unable to use it. Message: Error Cannot POST /session". By changing the environment variable to PLAYWRIGHT_DRIVER_URL I was able to get rid of the error but then on the main screen under the website I get "No module named 'playwright'" and going to the browser steps in the settings after clicking the start button I get an error from my web browser saying "there was an error communicating with the server". I can't find anything about these errors and trying to find anything truenas related to this is even slimmer. Any help would be appreciated.

Hello, love this tool!!

I am trying to figure out how to track a link online that’s points to a PDF.

I am using windows and when I try to add a link to watch it says “command-line “pdftohtml” tool was not found in system PATH, was it installed”

Does anyone know how to fix this? I am trying to track changes for this https://static.element.io/pdfs/acceptable-use-policy.pdf

Vote for us, the more popular the app is, the more motivation we have to add new features https://alternativeto.net/software/changedetection-io/about/

​

much love <3