Commit Graph

240 Commits (sent-test-default-format-notification)

Author SHA1 Message Date
dgtlmoon dcf4bf37ed
Code/Test - Improve testing for creating backups
1 year ago
dgtlmoon 22b2068208
Ability to select "No proxy" for a watch when you have proxy's configured
1 year ago
Tiago Ilieve 3b875e5a6a
Add 'diff_patch' notification body token - This will allow the diff to be generated in the "unified patch format." (#1765)
1 year ago
dgtlmoon 40d01acde9 Fix - Regular Expression text in `ignore` and `trigger` were not processing correctly, also refactored for lower CPU usage (#1747)
1 year ago
dgtlmoon 52df3b10e7
UI - Ability to highlight text and have it offered as a ignore-text option, really nice easy way to set ignores on changing text (#1746)
1 year ago
dgtlmoon 37ff5f6d37
Bug - SMTP mailto:// Notification content-type (HTML/Text) fix and add CI tests (#1660)
2 years ago
dgtlmoon 572f71299f
Bug fix - Notification settings were not cascading from global -> tags -> watch correctly in some cases (#1654)
2 years ago
dgtlmoon 5f150c4f03
Bug - Fix watch clone (#1647)
2 years ago
dgtlmoon 52f2c00308
UI/Functionality - Ability to manage/apply filters and notifications across tags/groups
2 years ago
dgtlmoon a4c620c308
Code - Adding CI test for search (#1626)
2 years ago
Maciej Rapacz a4e6fd1ec3
Fetcher / Parser - Automatically attempt to extract JSON from document when document contains JSON but could be wrapped in HTML (#1593)
2 years ago
dgtlmoon d8b9f0fd78
Test improvement - Also test that custom request headers works with Playwright/Browserless (#1607)
2 years ago
dgtlmoon f9387522ee
Fetching - Be sure that content-type detection works when the headers are a mixed case (#1604)
2 years ago
dgtlmoon 9e954532d6
Fetcher - Ability to specify headers from a textfile per watch, global or per tag ( https://github.com/dgtlmoon/changedetection.io/wiki/Adding-headers-from-an-external-file )
2 years ago
dgtlmoon 9076ba6bd3 Tests - error test - be sure to clear results from other test parts
2 years ago
dgtlmoon ad75e8cdd0 Tests - Add test to check that low level fetch errors are cleared on next check
2 years ago
dgtlmoon d5f574ca17
Notifications - Include triggered text token as `{{triggered_text}}` in notifications, so you can send just the content that matches. (#1485)
2 years ago
dgtlmoon 55b6ae86e8
Ability to set which text to process triggers on (added, removed, changed) according to the difference (#1483)
2 years ago
dgtlmoon 3b80bb2f0e
Use brotli for reducing the size of the text snapshots (#1482)
2 years ago
dgtlmoon e6d2d87b31
Notification screenshots - now PNG only for now to save disk space (no point creating two images) (#1481)
2 years ago
dgtlmoon 6e71088cde New feature - Restock / stock / out of stock monitor option/mode
2 years ago
dgtlmoon 4c74d39df0
Code - Abstract out the diff fetch types to make it easier to integrate new ones (#1467)
2 years ago
dgtlmoon 6f1eec0d5a
Fixing bad linebreak definition `</br>` in notifications and UI (#1465)
2 years ago
reecespieces 0d05ee1586
Notification Improvements - New tokens `{{diff_added}}` and `{{diff_removed}}`, removed whitespace around `added` and `into` ( Issue #905 ) (#1454)
2 years ago
dgtlmoon 8253074d56
False change alerts fix - Don't reset watch checksum when a fetch error happens, adjust test to not test for fluctuating filter (#1437)
2 years ago
dgtlmoon 0ed897c50f
New setting to allow passwordless access to your 'diff' page - perfect for sharing your diff page securely, refactored login code (#1357)
2 years ago
dgtlmoon f8e587c415
Security - Possible stored XSS in watch list - Only permit HTTP/HTTP/FTP by default - override with env var `SAFE_PROTOCOL_REGEX` (#1359)
2 years ago
dgtlmoon 7048a0acbd
UI - Fix wrong logic when dealing with webdriver/playwright watch screenshot settings (#1325)
2 years ago
dgtlmoon 024c8d8fd5
API - Improvements, support PUT for updating existing watch, set muted state, set paused state, see https://changedetection.io/docs/api_v1/index.html (#1213)
2 years ago
jtagcat 58c7cbeac7
UI: Updating queued success message (#1285)
2 years ago
dgtlmoon fc6424c39e
Test improvements (#1264)
2 years ago
dgtlmoon e99f07a51d
Filters & Notifications - fixed tokens in filter not found notification
2 years ago
dgtlmoon fcfd1b5e10
Ability to configure extra proxies via the UI (#1235)
2 years ago
dgtlmoon 13c4121f52
PDF File change detection - Initial PDF fetcher support with basic text extraction (#1244)
2 years ago
dgtlmoon e8e176f3bd
Testing - Run test as fully built docker container (#1245)
2 years ago
dgtlmoon b7a2501d64
Fetching - Always sort the key order of JSON content for less false alerts (May cause an alert on upgrade, but will be better going forwards) #1219
2 years ago
dgtlmoon b58fd995b5 Automatically offer to track LD+JSON product price data (#1204)
2 years ago
dgtlmoon 3e333496c1
Test cleanups (#1196)
2 years ago
dgtlmoon 265f622e75
Notification - Support for standard API calls post:// posts:// get:// gets:// delete:// deletes:// put:// puts:// (#1194)
2 years ago
dgtlmoon c12db2b725
Notifications - tokens/jinja2 templating (#1184)
2 years ago
dgtlmoon 69662ff91c
Test improvement - improving notification error network test
2 years ago
dgtlmoon 2345b6b558
New feature - Simple extract data by regex from all historical watch text into CSV (#1191)
2 years ago
dgtlmoon 5b530ff61c
Configurable "Browser Steps" when Playwright/Chrome is configured (enter text, scroll, wait for text, click button etc) (#478)
2 years ago
dgtlmoon ce6c2737a8
Notification screenshot/JPEG was not being regenerated correctly (#1149)
2 years ago
dgtlmoon 35d44c8277
Notification screenshot option should only be available to webdriver/playwright watches, screenshot sent as JPEG to save bandwidth, Simplify the logic around screenshot, (#1140)
2 years ago
dgtlmoon d07d7a1b18
Minor test improvements
2 years ago
Matthias Bilger f066a1c38f
Option to attach screenshot to notification (#1127)
2 years ago
dgtlmoon 359fc48fb4
Filters can now accept a list/multiple filters (#1064) #623
2 years ago
dgtlmoon c197c062e1
Disable version check when pytest is running (#1084)
2 years ago
dgtlmoon 77b59809ca
Removing unused code (#1070)
2 years ago
dgtlmoon 72834a42fd
Backups and Snapshots - Data directory now fully portable, (all paths are relative) , refactored backup zip export creation
2 years ago
dgtlmoon 724cb17224
Re #1052 - Dynamic URLs, use variables in the URL (such as the current date, the date in a month, and other logic see https://github.com/dgtlmoon/changedetection.io/wiki/Handling-variables-in-the-watched-URL ) (#1057)
2 years ago
dgtlmoon 5d40e16c73
API - Adding basic system info/system state API (#1051)
2 years ago
dgtlmoon 32ea1a8721
Windows - JQ - Make library optional so it doesnt break Windows pip installs (#1009)
2 years ago
dgtlmoon fff32cef0d
Adding test - Test the 'execute JS before changedetection' (#1006)
2 years ago
Yusef Ouda dfa7fc3a81
Adds support for jq JSON path querying engine (#1001)
2 years ago
dgtlmoon d4715e2bc8
Tidy up proxies.json logic, adding tests (#955)
2 years ago
dgtlmoon 0c111bd9ae
Further notification settings refinement (#910)
2 years ago
dgtlmoon fefc39427b
Test improvement - Visual selector data loads as JSON (#895)
2 years ago
dgtlmoon 2c6faa7c4e
Cleaner separation of watch/global notification settings (#894)
2 years ago
dgtlmoon d67c654f37
Be sure visual-selector data is set when xPath/CSS filter is not yet found (#851)
2 years ago
dgtlmoon 9942107016
Massive improvements to error handling - show separate output for non HTTP 200 status replies
2 years ago
dgtlmoon 8c466b4826 Test fix - Remove debug from test
2 years ago
dgtlmoon 6f072b42e8
Security update - Password could be unset from settings form unexpectedly (#808)
2 years ago
dgtlmoon 8fef3ff4ab
[preview current] cleanup code and add test
2 years ago
dgtlmoon 488699b7d4 Test improvement - remove unnecessary step
2 years ago
dgtlmoon daae43e9f9
Bug fix: Filter failure detection notification was interfering with change-detection results, added test case (#786)
2 years ago
dgtlmoon 5bd9eaf99d
UI Feature - Add watch in "paused" state, saving then unpauses (#779)
2 years ago
dgtlmoon b1c51c0a65
Enhancement - support xPath text() function filter, for example "//title/text()" in RSS feeds (#778)
2 years ago
dgtlmoon faa42d75e0 Refactor of extract text filter - Regex, support Regex (groups) and all python regex flags via /something/aiLmsux (#773)
2 years ago
dgtlmoon 291700554e
Bug fix for alerting when xPath based filters are no longer present (#772)
2 years ago
dgtlmoon a82fad7059 Send notification when CSS/xPath filter is missing after more than 6 (configurable) attempts (#771)
2 years ago
dgtlmoon dd0eeca056 Handle simple obfuscations - HomeDepot.com style price obfuscation (#764)
2 years ago
dgtlmoon 2ba3a6d53f Test improvement: Extract text should return all matches
3 years ago
dgtlmoon 2b054ced8c
[new filter] Filter option - Trigger only when NEW content (lines) are detected ( compared to earlier text snapshots ) (#685)
3 years ago
dgtlmoon 83555a9991
bug fix: `last_changed` was being set on the first fetch, should only be set on the change after the first fetch #705
3 years ago
dgtlmoon 7da32f9ac3 New filter - Block change-detection if text matches - for example, block change-detection while the text "out of stock" is on the page, know when the text is no longer on the page (#698)
3 years ago
dgtlmoon 2ba00d2e1d
Notifications log - log what was sent after applying all cleanups
3 years ago
dgtlmoon 4101ae00c6
New feature - "Extract text" filter ability (#624)
3 years ago
dgtlmoon 7929aeddfc
'Mark all viewed' button was missing in this version, added test also. (#652)
3 years ago
dgtlmoon aa3c8a9370
Move history data to a textfile, improves memory handling (#638)
3 years ago
dgtlmoon 5cefb16e52 Minor code cleanup
3 years ago
dgtlmoon 341ae24b73 Re #616 - content trigger - adding extra test (#620)
3 years ago
dgtlmoon eef56e52c6 Adding new Visual Selector for choosing the area of the webpage to monitor - playwright/browserless only (#566)
3 years ago
dgtlmoon e17c2121f7 Fix encoding errors with XPath filters from UTF-8 responses (#619)
3 years ago
dgtlmoon 07e279b38d
API Interface (#617)
3 years ago
dgtlmoon 6734fb91a2
Option to control if pages with no renderable content are a change (example: JS webapps that dont render any text sometimes) (#608)
3 years ago
dgtlmoon f28c260576
Distill.io JSON export file importer (#592)
3 years ago
dgtlmoon c0d0424e7e
Data storage bug fix #569
3 years ago
dgtlmoon 06517bfd22
Ability to 'Share' a watch by a generated link, this will include all filters and triggers - see Wiki (#563)
3 years ago
dgtlmoon 9e708810d1
Seconds/minutes/hours/days between checks form field upgrade from 'minutes' only (#512)
3 years ago
dgtlmoon 015353eccc Form field handling improvements - fixing field list handler for empty lines
3 years ago
dgtlmoon 8f062bfec9
Refactor form handling (#548)
3 years ago
dgtlmoon 380c512cc2
Adding support for change detection of HTML source-code via "source:https://website.com" prefix (#540)
3 years ago
dgtlmoon 9809af142d
Option to render links as [Some Text ](/link), adds the ability to change-detect on hyperlink changes
3 years ago
dgtlmoon 3034d047c2
Introduce an AJAX button for sending test notifications instead of the checkbox (#519)
3 years ago
dgtlmoon 8f40f19328
RSS feed CDATA should contain difference output
3 years ago
dgtlmoon 082634f851
Fix - {diff} and {diff_full} notifications tokens were not always including the full output
3 years ago
dgtlmoon 942c3f021f
Allow changedetector to ignore status codes as a per-site setting (#479) (#485)
3 years ago
dgtlmoon 5483f5d694
Security update - Use CSRF token protection for forms, make "remove password" use HTTP Post (#484)
3 years ago
dgtlmoon f2fa638480
Security update - Protect against file:/// type access by webdriver/chrome. (#483)
3 years ago
dgtlmoon 3e8a15456a
Detect byte-encoding when the server mishandles the content-type header reply (#472)
3 years ago
dgtlmoon ffad5cca97
JSON diff/preview should use utf-8 encoding where possible (#465)
3 years ago
Tim Loderhose d4359c2e67
Add filter to remove elements by CSS rule from HTML before change detection is run (#445)
3 years ago
dgtlmoon 7ce9e4dfc2
Testing - Refactor HTTP Request Type test (#453)
3 years ago
dgtlmoon 96664ffb10
Better text/plain detection and refactor tests (#443)
3 years ago
dgtlmoon b401998030 Ensure string matching on the ignore filter is always case-INsensitive
3 years ago
dgtlmoon 014fda9058
Ability to visualise trigger and filter rules against the current snapshot on the preview page
3 years ago
dgtlmoon eb3dca3805 Language fix "watches are rechecking." it actually puts them into an internal queue "watches are QUEUED for rechecking"
3 years ago
dgtlmoon 22ef9afb93
Refactor tests for notification error log handler (#404)
3 years ago
dgtlmoon abaec224f6
Notification error log handler (#403)
3 years ago
Tim Loderhose 4887180671
Add option for tags on import (#377)
3 years ago
Travis Howse abe88192f4
Fix bug where diff and diff_full were switched in notification templates. (#380)
3 years ago
dgtlmoon a896493797
Simple HTTP auth (#372)
3 years ago
dgtlmoon 271181968f
Notification settings defaults and validation (#361)
3 years ago
dgtlmoon ecfc02ba23 Merge branch 'master' of github.com:dgtlmoon/changedetection.io
3 years ago
dgtlmoon 3331ccd061 Add test for low-level network error text handling
3 years ago
Unpublished bd8f389a65
Add API endpoint for current snapshot (#359)
3 years ago
dgtlmoon 59d31bf76f
XPath support (#355)
3 years ago
dgtlmoon f87f7077a6
Better handling of EmptyReply exception, always bump 'last_checked' in the case of an error (#354)
3 years ago
dgtlmoon b33105d576 Re #348 - Add test for backup, use proper datastore path
3 years ago
Unpublished 023951a10e
Be sure that documents returned with a application/json header are not parsed with inscriptis (#337)
3 years ago
dgtlmoon b5c1fce136
Re #133 Option for ignoring whitespacing (#345)
3 years ago
dgtlmoon 489671dcca
Re #342 notification encoding (#343)
3 years ago
dgtlmoon 0439acacbe
Adding global ignore text (#339)
3 years ago
Simon Caron dfcae4ee64
Extend Request Parameters to add Body & Method (#325)
3 years ago
dgtlmoon 9815fc2526
RSS allow access via token (#310)
3 years ago
dgtlmoon 35d0c74454
Re #308 - Adding test and including settings in clone operation (#309)
3 years ago
dgtlmoon 5a10acfd09
Send diff in notifications (#296)
3 years ago
dgtlmoon 7f8c0fb2fa
Check that a notification URL is set when sending the test notification (#300)
3 years ago
ghjklw ecba130fdb
Enable Markdown and HTML notifications. (#288)
3 years ago
dgtlmoon a8e92e2226
Re #265 - extended jsonpath support (#266)
3 years ago
dgtlmoon 6e4ddacaf8
Re #257 - Handle bool val of json path better (#263)
3 years ago
dgtlmoon 95e39aa727
Configurable BASE_URL (#228)
3 years ago
dgtlmoon cd7df86f54
Re #242 - app was treating notification field defaults as the field value (#244)
3 years ago
dgtlmoon b903280cd0
Re #185 - [feature] Custom notifications templates per watch (#226)
3 years ago
Minty b9e0ad052f
New notification tokens - watch_uuid, watch_title, watch_tag, (#201)
3 years ago
dgtlmoon fbe9270528
Re #203 - validate tokens (#204)
3 years ago
dgtlmoon 5fb9bbdfa3 Test - prove that notifications are not being sent when content does not change
3 years ago
dgtlmoon a11b6daa2e
Installation via pip (#186)
3 years ago