Web app to detect changes in content in a website.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Go to file
dgtlmoon f87f7077a6
Better handling of EmptyReply exception, always bump 'last_checked' in the case of an error (#354)
3 years ago
.github Update feature_request.md 3 years ago
changedetectionio Better handling of EmptyReply exception, always bump 'last_checked' in the case of an error (#354) 3 years ago
.dockerignore Adding dockerignore 4 years ago
.gitignore New notification tokens - watch_uuid, watch_title, watch_tag, (#201) 3 years ago
CONTRIBUTING.md Create CONTRIBUTING.md 3 years ago
Dockerfile Re #80, sets SECLEVEL=1 in openssl.conf to allow monitoring sites with weak/old cipher suites (#312) 3 years ago
LICENSE Create LICENSE 4 years ago
MANIFEST.in Setting for Extract <title> as title option on individual watches (#229) 3 years ago
Procfile Tweaking heroku Procfile 3 years ago
README-pip.md Installation via pip (#186) 3 years ago
README.md fix typo in README.md (#350) 3 years ago
app.json Adding heroku app.json app 3 years ago
btc-support.png Adding BTC support instructions 4 years ago
changedetection.py -C option to create a datadir if it doesnt exist 3 years ago
docker-compose.yml Adding note in comments for working arm64 chrome with rPi-4 (#336) 3 years ago
heroku.yml Try simpler heroku recipe 3 years ago
requirements-dev.txt Installation via pip (#186) 3 years ago
requirements.txt Use selenium 4.1.0 3 years ago
runtime.txt Tweak runtime Heroku version 3 years ago
screenshot-diff.png Adding diff screenshot 4 years ago
screenshot-notifications.png Apprise notifications (#43) 4 years ago
screenshot.png high res 3 years ago
setup.py Installation via pip (#186) 3 years ago

README.md

changedetection.io

Release Version Docker Pulls License

changedetection.io

Self-Hosted, Open Source, Change Monitoring of Web Pages

Know when web pages change! Stay ontop of new information!

Live your data-life pro-actively instead of re-actively, do not rely on manipulative social media for consuming important information.

Open source web page monitoring, notification and change detection.

Self-hosted web page change monitoring

Deploy

Read the Heroku notes and limitations wiki page first

Example use cases

  • Products and services have a change in pricing
  • Governmental department updates (changes are often only on their websites)
  • New software releases, security advisories when you're not on their mailing list.
  • Festivals with changes
  • Realestate listing changes
  • COVID related news from government websites
  • University/organisation news from their website
  • Detect and monitor changes in JSON API responses
  • API monitoring and alerting
  • Changes in legal and other documents
  • Trigger API calls via notifications when text appears on a website
  • Glue together APIs using the JSON filter and JSON notifications
  • Create RSS feeds based on changes in web content
  • You have a very sensitive list of URLs to watch and you do not want to use the paid alternatives. (Remember, you are the product)

Need an actual Chrome runner with Javascript support? We support fetching via WebDriver!

Get monitoring now! super simple.

Deploy to Heroku for free, Run this python directly, or with docker and/or docker-compose

Screenshots

Examining differences in content.

Self-hosted web page change monitoring context difference

Please star this project and help it grow! https://github.com/dgtlmoon/changedetection.io/

Installation

Docker

With Docker composer, just clone this repository and..

$ docker-compose up -d

Docker standalone

$ docker run -d --restart always -p "127.0.0.1:5000:5000" -v datastore-volume:/datastore --name changedetection.io dgtlmoon/changedetection.io

Python Pip

Check out our pypi page https://pypi.org/project/changedetection.io/

$ pip3 install changedetection.io
$ changedetection.io -d /path/to/empty/data/dir -p 5000

Then visit http://127.0.0.1:5000 , You should now be able to access the UI.

Now with per-site configurable support for using a fast built in HTTP fetcher or use a Chrome based fetcher for monitoring of JavaScript websites!

Updating changedetection.io

Docker

docker pull dgtlmoon/changedetection.io
docker kill $(docker ps -a|grep changedetection.io|awk '{print $1}')
docker rm $(docker ps -a|grep changedetection.io|awk '{print $1}')
docker run -d --restart always -p "127.0.0.1:5000:5000" -v datastore-volume:/datastore --name changedetection.io dgtlmoon/changedetection.io

docker-compose

docker-compose pull && docker-compose up -d

Notifications

ChangeDetection.io supports a massive amount of notifications (including email, office365, custom APIs, etc) when a web-page has a change detected thanks to the apprise library. Simply set one or more notification URL's in the [edit] tab of that watch.

Just some examples

discord://webhook_id/webhook_token
flock://app_token/g:channel_id
gitter://token/room
gchat://workspace/key/token
msteams://TokenA/TokenB/TokenC/
o365://TenantID:AccountEmail/ClientID/ClientSecret/TargetEmail
rocket://user:password@hostname/#Channel
mailto://user:pass@example.com?to=receivingAddress@example.com
json://someserver.com/custom-api
syslog://

And everything else in this list!

Self-hosted web page change monitoring notifications

Now you can also customise your notification content!

JSON API Monitoring

Detect changes and monitor data in JSON API's by using the built-in JSONPath selectors as a filter / selector.

image

This will re-parse the JSON and apply formatting to the text, making it super easy to monitor and detect changes in JSON API results

image

Parse JSON embedded in HTML!

When you enable a json: filter, you can even automatically extract and parse embedded JSON inside a HTML page! Amazingly handy for sites that build content based on JSON, such as many e-commerce websites.

<html>
...
<script type="application/ld+json">
  {"@context":"http://schema.org","@type":"Product","name":"Nan Optipro Stage 1 Baby Formula  800g","price": 23.50 }
</script>

json:$.price would give 23.50, or you can extract the whole structure

Proxy configuration

See the wiki https://github.com/dgtlmoon/changedetection.io/wiki/Proxy-configuration

Raspberry Pi support?

Raspberry Pi and linux/arm/v6 linux/arm/v7 arm64 devices are supported!

Windows native support?

Sorry not yet :( https://github.com/dgtlmoon/changedetection.io/labels/windows

Support us

Do you use changedetection.io to make money? does it save you time or money? Does it make your life easier? less stressful? Remember, we write this software when we should be doing actual paid work, we have to buy food and pay rent just like you.

Please support us, even small amounts help a LOT.

BTC 1PLFN327GyUarpJd7nVe7Reqg9qHx5frNn

Support us!