Web app to detect changes in content in a website.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Go to file
dgtlmoon 7e87591ae5
test fix - dont trigger notifications in header test
3 years ago
.github use a github action for getting the tag 4 years ago
backend test fix - dont trigger notifications in header test 3 years ago
.dockerignore Adding dockerignore 4 years ago
.gitignore WIP, separate out the Flask from everything else, get pytest working 4 years ago
Dockerfile Re #93 - tweak build packages 4 years ago
LICENSE Create LICENSE 4 years ago
README.md Update README.md 4 years ago
btc-support.png Adding BTC support instructions 4 years ago
changedetection.py #76 app path prefix when behind proxy_pass (#91) 4 years ago
docker-compose.yml #76 app path prefix when behind proxy_pass (#91) 4 years ago
requirements.txt Re #117 Jsonpath based JSON change detection filter (#125) 4 years ago
screenshot-diff.png Adding diff screenshot 4 years ago
screenshot-notifications.png Apprise notifications (#43) 4 years ago
screenshot.png Updating screenshot 4 years ago

README.md

changedetection.io

changedetection.io Docker Pulls Change detection latest tag version

Self-hosted change monitoring of web pages.

Know when web pages change! Stay ontop of new information!

Live your data-life pro-actively instead of re-actively, do not rely on manipulative social media for consuming important information.

Self-hosted web page change monitoring

Example use cases

Know when ...

  • Government department updates (changes are often only on their websites)
  • Local government news (changes are often only on their websites)
  • New software releases, security advisories when you're not on their mailing list.
  • Festivals with changes
  • Realestate listing changes
  • COVID related news from government websites
  • Detect and monitor changes in JSON API responses
  • API monitoring and alerting

Need an actual Chrome runner with Javascript support? see the experimental Javascript/Chrome support changedetection.io branch!

Get monitoring now! super simple, one command! Run the python code on your own machine by cloning this repository, or with docker and/or docker-compose

With one docker-compose command

docker-compose up -d

or

docker run -d --restart always -p "127.0.0.1:5000:5000" -v datastore-volume:/datastore --name changedetection.io dgtlmoon/changedetection.io

Now visit http://127.0.0.1:5000 , You should now be able to access the UI.

Updating to latest version

Highly recommended :)

docker pull dgtlmoon/changedetection.io
docker kill $(docker ps -a|grep changedetection.io|awk '{print $1}')
docker rm $(docker ps -a|grep changedetection.io|awk '{print $1}')
docker run -d --restart always -p "127.0.0.1:5000:5000" -v datastore-volume:/datastore --name changedetection.io dgtlmoon/changedetection.io

Screenshots

Examining differences in content.

Self-hosted web page change monitoring context difference

Please star this project and help it grow! https://github.com/dgtlmoon/changedetection.io/

Notifications

ChangeDetection.io supports a massive amount of notifications (including email, office365, custom APIs, etc) when a web-page has a change detected thanks to the apprise library. Simply set one or more notification URL's in the [edit] tab of that watch.

Just some examples

discord://webhook_id/webhook_token
flock://app_token/g:channel_id
gitter://token/room
gchat://workspace/key/token
msteams://TokenA/TokenB/TokenC/
o365://TenantID:AccountEmail/ClientID/ClientSecret/TargetEmail
rocket://user:password@hostname/#Channel
mailto://user:pass@example.com?to=receivingAddress@example.com
json://someserver.com/custom-api
syslog://

And everything else in this list!

Self-hosted web page change monitoring notifications

Now you can also customise your notification content!

JSON API Monitoring

Detect changes and monitor data in JSON API's by using the built-in JSONPath selectors as a filter / selector.

image

This will re-parse the JSON and apply formatting to the text, making it super easy to monitor and detect changes in JSON API results

image

Proxy

A proxy for ChangeDetection.io can be configured by setting environment the HTTP_PROXY, HTTPS_PROXY variables, examples are also in the docker-compose.yml

NO_PROXY exclude list can be specified by following "localhost,192.168.0.0/24"

as docker run with -e

docker run -d --restart always -e HTTPS_PROXY="socks5h://10.10.1.10:1080" -p "127.0.0.1:5000:5000" -v datastore-volume:/datastore --name changedetection.io dgtlmoon/changedetection.io

With docker-compose, see the Proxy support example in docker-compose.yml.

For more information see https://docs.python-requests.org/en/master/user/advanced/#proxies

This proxy support also extends to the notifications https://github.com/caronc/apprise/issues/387#issuecomment-841718867

Notes

  • Does not yet support Javascript
  • Wont work with Cloudfare type "Please turn on javascript" protected pages
  • You can use the 'headers' section to monitor password protected web page changes

See the experimental Javascript/Chrome browser support!

RaspberriPi support?

RaspberriPi and linux/arm/v6 linux/arm/v7 arm64 devices are supported!

Support us

Do you use changedetection.io to make money? does it save you time or money? Does it make your life easier? less stressful? Remember, we write this software when we should be doing actual paid work, we have to buy food and pay rent just like you.

Please support us, even small amounts help a LOT.

BTC 1PLFN327GyUarpJd7nVe7Reqg9qHx5frNn

Support us!