Commit Graph

230 Commits (5e95dc62a538e64a783c8f56b1402a01b7ab40cc)

Author SHA1 Message Date
dgtlmoon bd6eda696c
Merge pull request from GHSA-4r7v-whpg-8rx3
8 months ago
dgtlmoon 74707909f1
Bug fix for newer lxml module - module 'lxml.etree' has no attribute '_ElementStringResult' - reimplement _ElementStringResult (#2313 #2312)
8 months ago
dgtlmoon f9954f93f3
UI - Adding UI notice if watch has group options set (#2311 #2307)
8 months ago
dgtlmoon 387ce32e6f
Restock detection - Improving test for restock IN STOCK -> OUT OF STOCK (#2219)
10 months ago
dgtlmoon 14e632bc19
Custom headers fix in Browser Steps and Playwright/Puppeteer fetchers ( #2197 )
10 months ago
Constantin Hong 52c895b2e8
text_json_diff/fix: Keep an order of filter and remove duplicated filters. 2 (#2178)
10 months ago
dgtlmoon 823a0c99f4
Code - Split content fetcher code up (playwright, puppeteer and requests), fix puppeteer direct chrome support (#2169)
11 months ago
dgtlmoon c5a4e0aaa3
Fetching - Prefer to use SockPuppetBrowser (#2163)
11 months ago
dgtlmoon 616c0b3f65
New text filter - Sort text alphabetically filter (#2153)
11 months ago
dgtlmoon 7d96b4ba83
Fetching - Always record `server` software reply headers (will be used in the future) (#2143)
11 months ago
dgtlmoon fca40e4d5b
Testing - General test workflow improvements (#2144)
11 months ago
dgtlmoon 9510345e01
Test - tidy up backup test (#2117)
11 months ago
Constantin Hong 4be0fafa93
Support Loguru as a logger (#2036)
11 months ago
dgtlmoon c3d825f38c
Test - Adding extra test for HTML output in emails ( #2103 )
12 months ago
dgtlmoon 65428655b8
Notifications - When any in a list of notifications fails, the others should still work (#2106)
12 months ago
dgtlmoon 8e207ba438
API - Ability to add/import bulk list of watches as a line-feed separated list (#2021)
1 year ago
dgtlmoon f0823126c8
Notifications - Fixing support for headers in custom post://, posts:// notifications, ability to include HTTP headers when making custom notifications (#2018)
1 year ago
dgtlmoon bbc18d8e80
API - Make sure the watch "is viewed" attribute is correctly represented in the API output (#2009)
1 year ago
dgtlmoon 8fd57280b7
Testing - Improve PDF text change detection tests (#1992)
1 year ago
dgtlmoon 0285d00f13
UI - Clicking the "[Diff]" link should take you to the difference starting at the relative time to when you last viewed the difference page (#1989)
1 year ago
dgtlmoon f7f98945a2
Visual Selector - xPath handling misc fixes (#1976)
1 year ago
Constantin Hong 26931e0167
feature: Support XPath2.0 to 3.1 (#1774)
1 year ago
dgtlmoon 5229094e44
New functionanlity - Selectable browser / ability to add extra browser connections (good for using "scraping browsers"/ etc) (#1943)
1 year ago
dgtlmoon c8dcc072c8
Code refactor for fetchers (#1941)
1 year ago
dgtlmoon 99246d3e6d
Visual Selector - Small fix, Improving elements fetcher reliability (#1947)
1 year ago
Jai Gupta d3c8386874
Import - Improved Wachete Excel XLS import support for "dynamic wachet" (sets correct state of using chrome browser or not) column (#1934)
1 year ago
dgtlmoon 47103d7f3d
Refactor Excel / wachete import, extend tests (#1931)
1 year ago
dgtlmoon 03c671bfff
Build - Upgrading pip packages (#1915)
1 year ago
dgtlmoon e209d9fba0
Ability to Import from Wachete XLSX (or any XLSX) - Wachete alternative made easy (#1921)
1 year ago
dgtlmoon 6a589e14f3
BrowserSteps - Wrong text taken from browser steps (#1911)
1 year ago
dgtlmoon e1860549dc
Fetching - Browser Step enabled watches should also identify 404/non-200 status situations (#1907)
1 year ago
dgtlmoon 9765d56a23
Text Filters - "Extract Text" filter was not being error checked properly when using a RegEx (#1902)
1 year ago
dgtlmoon 7220afab0a
RSS fetch - RSS field <title> was not rendering as text correctly, added workaround #1879
1 year ago
dgtlmoon f707c914b6
RSS Fetching - Handle CDATA (commented out text) in RSS correctly, generally handle RSS better (#1866)
1 year ago
dgtlmoon c0b49d3be9 Testing - Improve xPath tests (#1863)
1 year ago
dgtlmoon da421fe110
UI - Ability to select between any difference date ( from / to ) and minor UI cleanup for differences page (#1855)
1 year ago
dgtlmoon 7debccca73
Fetching - Clarifying how fetchers work with SOCKS5 proxies
1 year ago
dgtlmoon ceac8c21e4
LD JSON Price followers - Handle incorrectly created LD-JSON price structures better (#1837)
1 year ago
dgtlmoon 2b948c15c1
Backend - Regular expression / string filtering refactor for Python 3.11 and deprecation warnings since Python 3.6 (#1786)
1 year ago
dgtlmoon e30b17b8bc
UI + Fetching - Be more helpful when a filter contains no text, suggest ways to deal with images in filters (#1819)
1 year ago
dgtlmoon dcf4bf37ed
Code/Test - Improve testing for creating backups
1 year ago
dgtlmoon 22b2068208
Ability to select "No proxy" for a watch when you have proxy's configured
1 year ago
Tiago Ilieve 3b875e5a6a
Add 'diff_patch' notification body token - This will allow the diff to be generated in the "unified patch format." (#1765)
1 year ago
dgtlmoon 40d01acde9 Fix - Regular Expression text in `ignore` and `trigger` were not processing correctly, also refactored for lower CPU usage (#1747)
1 year ago
dgtlmoon 52df3b10e7
UI - Ability to highlight text and have it offered as a ignore-text option, really nice easy way to set ignores on changing text (#1746)
1 year ago
dgtlmoon 37ff5f6d37
Bug - SMTP mailto:// Notification content-type (HTML/Text) fix and add CI tests (#1660)
2 years ago
dgtlmoon 572f71299f
Bug fix - Notification settings were not cascading from global -> tags -> watch correctly in some cases (#1654)
2 years ago
dgtlmoon 5f150c4f03
Bug - Fix watch clone (#1647)
2 years ago
dgtlmoon 52f2c00308
UI/Functionality - Ability to manage/apply filters and notifications across tags/groups
2 years ago
dgtlmoon a4c620c308
Code - Adding CI test for search (#1626)
2 years ago
Maciej Rapacz a4e6fd1ec3
Fetcher / Parser - Automatically attempt to extract JSON from document when document contains JSON but could be wrapped in HTML (#1593)
2 years ago
dgtlmoon d8b9f0fd78
Test improvement - Also test that custom request headers works with Playwright/Browserless (#1607)
2 years ago
dgtlmoon f9387522ee
Fetching - Be sure that content-type detection works when the headers are a mixed case (#1604)
2 years ago
dgtlmoon 9e954532d6
Fetcher - Ability to specify headers from a textfile per watch, global or per tag ( https://github.com/dgtlmoon/changedetection.io/wiki/Adding-headers-from-an-external-file )
2 years ago
dgtlmoon 9076ba6bd3 Tests - error test - be sure to clear results from other test parts
2 years ago
dgtlmoon ad75e8cdd0 Tests - Add test to check that low level fetch errors are cleared on next check
2 years ago
dgtlmoon d5f574ca17
Notifications - Include triggered text token as `{{triggered_text}}` in notifications, so you can send just the content that matches. (#1485)
2 years ago
dgtlmoon 55b6ae86e8
Ability to set which text to process triggers on (added, removed, changed) according to the difference (#1483)
2 years ago
dgtlmoon 3b80bb2f0e
Use brotli for reducing the size of the text snapshots (#1482)
2 years ago
dgtlmoon e6d2d87b31
Notification screenshots - now PNG only for now to save disk space (no point creating two images) (#1481)
2 years ago
dgtlmoon 6e71088cde New feature - Restock / stock / out of stock monitor option/mode
2 years ago
dgtlmoon 4c74d39df0
Code - Abstract out the diff fetch types to make it easier to integrate new ones (#1467)
2 years ago
dgtlmoon 6f1eec0d5a
Fixing bad linebreak definition `</br>` in notifications and UI (#1465)
2 years ago
reecespieces 0d05ee1586
Notification Improvements - New tokens `{{diff_added}}` and `{{diff_removed}}`, removed whitespace around `added` and `into` ( Issue #905 ) (#1454)
2 years ago
dgtlmoon 8253074d56
False change alerts fix - Don't reset watch checksum when a fetch error happens, adjust test to not test for fluctuating filter (#1437)
2 years ago
dgtlmoon 0ed897c50f
New setting to allow passwordless access to your 'diff' page - perfect for sharing your diff page securely, refactored login code (#1357)
2 years ago
dgtlmoon f8e587c415
Security - Possible stored XSS in watch list - Only permit HTTP/HTTP/FTP by default - override with env var `SAFE_PROTOCOL_REGEX` (#1359)
2 years ago
dgtlmoon 7048a0acbd
UI - Fix wrong logic when dealing with webdriver/playwright watch screenshot settings (#1325)
2 years ago
dgtlmoon 024c8d8fd5
API - Improvements, support PUT for updating existing watch, set muted state, set paused state, see https://changedetection.io/docs/api_v1/index.html (#1213)
2 years ago
jtagcat 58c7cbeac7
UI: Updating queued success message (#1285)
2 years ago
dgtlmoon fc6424c39e
Test improvements (#1264)
2 years ago
dgtlmoon e99f07a51d
Filters & Notifications - fixed tokens in filter not found notification
2 years ago
dgtlmoon fcfd1b5e10
Ability to configure extra proxies via the UI (#1235)
2 years ago
dgtlmoon 13c4121f52
PDF File change detection - Initial PDF fetcher support with basic text extraction (#1244)
2 years ago
dgtlmoon e8e176f3bd
Testing - Run test as fully built docker container (#1245)
2 years ago
dgtlmoon b7a2501d64
Fetching - Always sort the key order of JSON content for less false alerts (May cause an alert on upgrade, but will be better going forwards) #1219
2 years ago
dgtlmoon b58fd995b5 Automatically offer to track LD+JSON product price data (#1204)
2 years ago
dgtlmoon 3e333496c1
Test cleanups (#1196)
2 years ago
dgtlmoon 265f622e75
Notification - Support for standard API calls post:// posts:// get:// gets:// delete:// deletes:// put:// puts:// (#1194)
2 years ago
dgtlmoon c12db2b725
Notifications - tokens/jinja2 templating (#1184)
2 years ago
dgtlmoon 69662ff91c
Test improvement - improving notification error network test
2 years ago
dgtlmoon 2345b6b558
New feature - Simple extract data by regex from all historical watch text into CSV (#1191)
2 years ago
dgtlmoon 5b530ff61c
Configurable "Browser Steps" when Playwright/Chrome is configured (enter text, scroll, wait for text, click button etc) (#478)
2 years ago
dgtlmoon ce6c2737a8
Notification screenshot/JPEG was not being regenerated correctly (#1149)
2 years ago
dgtlmoon 35d44c8277
Notification screenshot option should only be available to webdriver/playwright watches, screenshot sent as JPEG to save bandwidth, Simplify the logic around screenshot, (#1140)
2 years ago
dgtlmoon d07d7a1b18
Minor test improvements
2 years ago
Matthias Bilger f066a1c38f
Option to attach screenshot to notification (#1127)
2 years ago
dgtlmoon 359fc48fb4
Filters can now accept a list/multiple filters (#1064) #623
2 years ago
dgtlmoon c197c062e1
Disable version check when pytest is running (#1084)
2 years ago
dgtlmoon 77b59809ca
Removing unused code (#1070)
2 years ago
dgtlmoon 72834a42fd
Backups and Snapshots - Data directory now fully portable, (all paths are relative) , refactored backup zip export creation
2 years ago
dgtlmoon 724cb17224
Re #1052 - Dynamic URLs, use variables in the URL (such as the current date, the date in a month, and other logic see https://github.com/dgtlmoon/changedetection.io/wiki/Handling-variables-in-the-watched-URL ) (#1057)
2 years ago
dgtlmoon 5d40e16c73
API - Adding basic system info/system state API (#1051)
2 years ago
dgtlmoon 32ea1a8721
Windows - JQ - Make library optional so it doesnt break Windows pip installs (#1009)
2 years ago
dgtlmoon fff32cef0d
Adding test - Test the 'execute JS before changedetection' (#1006)
2 years ago
Yusef Ouda dfa7fc3a81
Adds support for jq JSON path querying engine (#1001)
2 years ago
dgtlmoon d4715e2bc8
Tidy up proxies.json logic, adding tests (#955)
2 years ago
dgtlmoon 0c111bd9ae
Further notification settings refinement (#910)
2 years ago
dgtlmoon fefc39427b
Test improvement - Visual selector data loads as JSON (#895)
2 years ago
dgtlmoon 2c6faa7c4e
Cleaner separation of watch/global notification settings (#894)
2 years ago