Commit Graph

451 Commits (fetch-backend-ui-default)

Author SHA1 Message Date
dgtlmoon 3416532cd6
Playwright extension added back to Dockerfile to resolve conditional fix Alpine (musl) based systems () 2 years ago
dgtlmoon defc7a340e 0.39.21 2 years ago
dgtlmoon c197c062e1
Disable version check when pytest is running () 2 years ago
dgtlmoon 77b59809ca
Removing unused code () 2 years ago
dgtlmoon f90b170e68
Docker & python - Jq conditional pip requirements.txt include (Don't install in Windows because theres no Windows library/wheel) 2 years ago
dgtlmoon c93ca1841c
Docker & python - Use pip conditional requirements to not install playwright for ARM (unsupported on ARM) () 2 years ago
Sandro 57f604dff1
UI - Make fetch error more readable () 2 years ago
dgtlmoon 7f6a13ea6c
Re - Watch 'open' link should use any dynamic/template info () 2 years ago
dgtlmoon 9874f0cbc7 Remove accidental files 2 years ago
dgtlmoon 72834a42fd
Backups and Snapshots - Data directory now fully portable, (all paths are relative) , refactored backup zip export creation 2 years ago
dgtlmoon 724cb17224
Re - Dynamic URLs, use variables in the URL (such as the current date, the date in a month, and other logic see https://github.com/dgtlmoon/changedetection.io/wiki/Handling-variables-in-the-watched-URL ) () 2 years ago
dgtlmoon 4eb4b401a1 API - system info - allow 5 minutes grace before watch is considered 'overdue' 2 years ago
dgtlmoon 5d40e16c73
API - Adding basic system info/system state API () 2 years ago
Entepotenz 7839551d6b
Testing - Use same version of playwright while running tests as in production builds () 2 years ago
dgtlmoon 5a43a350de
History index safety check - Be sure that only valid history index lines are read () 2 years ago
Michael McMillan 3c31f023ce
Option to Hide the Referer header from monitored websites. () 2 years ago
dgtlmoon 4cbcc59461 0.39.20.4 2 years ago
dgtlmoon 4be0260381
Better cross platform file handling in diff and preview () 2 years ago
dgtlmoon 957a3c1c16 0.39.20.3 2 years ago
dgtlmoon 85897e0bf9
Windows - diff file handling improvements () 2 years ago
dgtlmoon 1b077abd93 0.39.20.2 2 years ago
dgtlmoon 32ea1a8721
Windows - JQ - Make library optional so it doesnt break Windows pip installs () 2 years ago
dgtlmoon fff32cef0d
Adding test - Test the 'execute JS before changedetection' () 2 years ago
dgtlmoon 8fb146f3e4 0.39.20.1 2 years ago
dgtlmoon 669fd3ae0b
Dont use default Requests `user-agent` and `accept` headers in playwright+selenium requests, breaks sites such as united.com. () 2 years ago
dgtlmoon 17d37fb626 0.39.20 2 years ago
Yusef Ouda dfa7fc3a81
Adds support for jq JSON path querying engine () 2 years ago
dgtlmoon cd467df97a
Adding link to BrightData Proxy info () 2 years ago
dgtlmoon 71bc2fed82 Remove quotationspage default watch 2 years ago
dgtlmoon 3ebb2ab9ba Selenium fetcher - screenshot should be taken after 'wait' time, not before 2 years ago
dgtlmoon 3705ce6681 Render Extract Configurable Delay Seconds should also apply after executing any JS 2 years ago
dgtlmoon f7ea99412f Re - remove change screensize, should be in 1280x720 default, was causing "Unable to retrieve content because the page is navigating and changing the content." on some sites 2 years ago
dgtlmoon d4715e2bc8
Tidy up proxies.json logic, adding tests () 2 years ago
dgtlmoon 77fdf59ae3 Improve Proxy minimum time debug output 2 years ago
dgtlmoon 0e194aa4b4 Default proxy settings fixes 2 years ago
dgtlmoon 2ba55bb477
Use proxies.json instead of proxies.txt - see wiki Proxies section () 2 years ago
dgtlmoon 22638399c1 0.39.19.1 2 years ago
dgtlmoon e3381776f2 Notification - code tidyup 2 years ago
dgtlmoon 26e2f21a80 Watch list & notification - Adding extra list batch operations for Mute, Unmute, Reset-to-default 2 years ago
dgtlmoon b6009ae9ff Notification - Reset defaults button should be on edit page only 2 years ago
dgtlmoon b046d6ef32 Notification watch settings - add button to make watch use defaults (empties the settings) 2 years ago
dgtlmoon e154a3cb7a Notification system update - set watch to use defaults if it is the same as the default 2 years ago
dgtlmoon 434c5813b9 0.39.19 2 years ago
dgtlmoon bd0fbaaf27
Use play and pause separate icons () 2 years ago
dgtlmoon 0c111bd9ae
Further notification settings refinement () 2 years ago
dgtlmoon ed9ac0b7fb
Reliability improvement - Check watch UUID exists when reporting missing path () 2 years ago
dgtlmoon fefc39427b
Test improvement - Visual selector data loads as JSON () 2 years ago
dgtlmoon 2c6faa7c4e
Cleaner separation of watch/global notification settings () 2 years ago
dgtlmoon 6168cd2899
Code maintenance - Removing old function () 2 years ago
dgtlmoon f3c7c969d8 Show screenshot age in [preview] 2 years ago
dgtlmoon 67d2441334 0.39.18 2 years ago
dgtlmoon 3c30bc02d5
More data saving pre-checks () 2 years ago
dgtlmoon b1e32275dc Checkbox operations - reorder buttons for safety 2 years ago
dgtlmoon e2a6865932
UI feature - Basic checkbox/group operations () 2 years ago
dgtlmoon f04adb7202
Bug fix - automatically queued watch checks weren't always being processed sequentially 2 years ago
dgtlmoon 1193a7f22c Playwright - Support proxy auth mechanisms () 2 years ago
dgtlmoon 5494e61a05 Skip processing when watch was deleted 2 years ago
dgtlmoon e461c0b819
Playwright fetcher didn't report low level HTTP errors correctly (like Connection Refused) () 2 years ago
dgtlmoon d67c654f37
Be sure visual-selector data is set when xPath/CSS filter is not yet found () 2 years ago
dgtlmoon 06ab34b6af Visual selector data not being saved by refactor 2 years ago
dgtlmoon ba8676c4ba
'Save chrome screenshot' checkbox never used, removing, we always save the screenshot. () 2 years ago
dgtlmoon 4899c1a4f9
Crash fix: Data store sub-directories werent always being created when needed () 2 years ago
dgtlmoon 9bff1582f7
Make the table header easier to understand when sorting () 2 years ago
dgtlmoon 269e3bb7c5
Column sorting () 2 years ago
dgtlmoon 1f250aa868 Revert "don't process paused entries after queue", so we can still manually recheck a paused watch 2 years ago
dgtlmoon 1c08d9f150
Remove 'last-changed' from url-watches.json and always calculate from history index () 2 years ago
dgtlmoon 9942107016
Massive improvements to error handling - show separate output for non HTTP 200 status replies 2 years ago
dgtlmoon 1eb5726cbf Execute JS should happen after waiting seconds 2 years ago
dgtlmoon f82d3b648a
Crash protection - handle the case where watch was deleted while being checked () 2 years ago
dgtlmoon 034b1330d4
Don't process a watch if it was paused after being queued () 2 years ago
dgtlmoon 4026575b0b 0.39.17.2 2 years ago
dgtlmoon 8c466b4826 Test fix - Remove debug from test 2 years ago
dgtlmoon 6f072b42e8
Security update - Password could be unset from settings form unexpectedly () 2 years ago
dgtlmoon e318253f31 Disable SIGCHLD Handler for now - keeping SIGTERM for DB writes 2 years ago
dgtlmoon f0f2fe94ce
Handle SIGTERM for cleaner shutdowns () 3 years ago
dgtlmoon 26f5c56ba4
Remove [save & preview] button, the preview is not updated live so it can lead to confusion () 3 years ago
dgtlmoon a1c3107cd6
Feature - priority queue - edited and added watches should get checked before automatically queued watches () 3 years ago
dgtlmoon 8fef3ff4ab
[preview current] cleanup code and add test 3 years ago
dgtlmoon baa25c9f9e
Feature - mute notifications () 3 years ago
dgtlmoon 488699b7d4 Test improvement - remove unnecessary step 3 years ago
dgtlmoon cf3a1ee3e3 0.39.17.1 3 years ago
dgtlmoon daae43e9f9
Bug fix: Filter failure detection notification was interfering with change-detection results, added test case () 3 years ago
dgtlmoon 3c9d2ded38 0.39.17 3 years ago
dgtlmoon 9f4364a130 Add https://discord.com/api notification hook to the automatic truncation due to Discords 2000 char limit 3 years ago
dgtlmoon 5bd9eaf99d
UI Feature - Add watch in "paused" state, saving then unpauses () 3 years ago
dgtlmoon b1c51c0a65
Enhancement - support xPath text() function filter, for example "//title/text()" in RSS feeds () 3 years ago
dgtlmoon 232bd92389
Bug fix - Filter "Only trigger when new lines appear" should check all history, not only the first item () 3 years ago
dgtlmoon e6173357a9 Visual Selector direct element finder fix 3 years ago
dgtlmoon 1f27865fdf Filter failure notification send default enable now controlled by setting Env var 3 years ago
dgtlmoon faa42d75e0 Refactor of extract text filter - Regex, support Regex (groups) and all python regex flags via /something/aiLmsux () 3 years ago
dgtlmoon 291700554e
Bug fix for alerting when xPath based filters are no longer present () 3 years ago
dgtlmoon a82fad7059 Send notification when CSS/xPath filter is missing after more than 6 (configurable) attempts () 3 years ago
dgtlmoon c2fe5ae0d1 mailto plaintext handling fix for 'plaintext' apprise integration 3 years ago
dgtlmoon 5beefdb7cc
Minor code cleanups 3 years ago
dgtlmoon 872bbba71c
Notifications - email - Correctly send plaintext notification email with plaintext header () 3 years ago
Jonathon Sisson d578de1a35
Form text tweak - Regex clarification () 3 years ago
dgtlmoon dd0eeca056 Handle simple obfuscations - HomeDepot.com style price obfuscation () 3 years ago
Brandon Wees ace44d0e00
Notifications fix - Discord - added discord webhook base url to truncation rules () 3 years ago
dgtlmoon 52d3d375ba removing package-lock.json - not required to be in git 3 years ago
dgtlmoon 08117089e6 Share-icon cleanups 3 years ago
dgtlmoon 2ba3a6d53f Test improvement: Extract text should return all matches 3 years ago
dgtlmoon 2f636553a9 Bug fix: RSS Feed should also announce utf-8 charset 3 years ago
Freddie Leeman 0bde48b282
Regex extract filter: Return all regex results instead of first match () 3 years ago
dgtlmoon fae1164c0b
Ability to specify JS before running change-detection () 3 years ago
dgtlmoon 169c293143 Playwright - log console errors to output 3 years ago
dgtlmoon 46cb5cff66 UI Improvement - Clarifying "Visual Filter" tool as "Visual Selector Filter" 3 years ago
Simo Elalj 05584ea886 Use environment variables to override new watch settings defaults (user-agent, timeout, workers) () 3 years ago
dgtlmoon 15569f9592 0.39.16 3 years ago
dgtlmoon 5f9e475fe0
Fix notification apprise application name to changedetection.io 3 years ago
dgtlmoon 2b054ced8c
[new filter] Filter option - Trigger only when NEW content (lines) are detected ( compared to earlier text snapshots ) () 3 years ago
dgtlmoon 6553980cd5
Playwright - Use HTTP Request Headers override (Cookie, etc) 3 years ago
jtagcat 7c12c47204
lang: prefer 'clear (snap) history' to 'scrub' () 3 years ago
dgtlmoon dbd9b470d7
Minor diff page improvements - list should be sorted 'newest first' and no need to include the current version to compare against () 3 years ago
dgtlmoon 83555a9991
bug fix: `last_changed` was being set on the first fetch, should only be set on the change after the first fetch 3 years ago
dgtlmoon 7da32f9ac3 New filter - Block change-detection if text matches - for example, block change-detection while the text "out of stock" is on the page, know when the text is no longer on the page () 3 years ago
dgtlmoon 76996b9eb8 Some changes werent getting triggered because the previous checksum only recorded when an event occured 3 years ago
dgtlmoon fba2b1a39d Notifications regression bug in 0.39.15 - only sent the first notification URL 3 years ago
dgtlmoon 4a91505af5 Playwright screenshots - no need for high-res "bug workaround" screenshot, use lower quality/faster configurable image quality env var 3 years ago
dgtlmoon 4841c79b4c Adding extra check when updating DB on ReplyWithContentButNoText 3 years ago
dgtlmoon 2ba00d2e1d
Notifications log - log what was sent after applying all cleanups 3 years ago
dgtlmoon 19c96f4bdd Re - tgram:// notifications - strip added HTML tag which is not supported by Telegram 3 years ago
dgtlmoon 82b900fbf4 Give more helpful error message when a page doesnt load 3 years ago
dgtlmoon 358a365303 Tweaks to playwright fetch code - better timeout handling 3 years ago
dgtlmoon a07ca4b136
Re - New functionality - Random "jitter" delay to requests () 3 years ago
dgtlmoon ba8cf2c8cf 0.39.15 3 years ago
dgtlmoon 3106b6688e Watch overview list - adding spinner to make it easier to see whats currently being 'Checked' 3 years ago
dgtlmoon 2c83845dac
Preview section - add helpful check 3 years ago
dgtlmoon 111266d6fa Send test notification - improved handling of errors 3 years ago
dgtlmoon ead610151f
Notification log - also log normal requests and make the log easier to find 3 years ago
dgtlmoon 327cc4af34 Use correct RSS CDATA handling () 3 years ago
dgtlmoon 6008ff516e
Improve logging () 3 years ago
dgtlmoon cdcf4b353f
New [scrub] button when editing a watch - scrub single watch history () 3 years ago
dgtlmoon 1ab70f8e86 Diff + Preview - Hide date selector widget when viewing screenshots as its not yet possible to compare screenshots (but will be soon!) 3 years ago
dgtlmoon 8227c012a7 Diff + Preview - Fixing screenshot behaviour after preference change 3 years ago
dgtlmoon c113d5fb24 Screenshot handling on the diff/preview section refactor () 3 years ago
dgtlmoon 8c8d4066d7 Shared watches - include "Extract text" filter 3 years ago
dgtlmoon 277dc9e1c1
Improve error message when filter not found in page result () 3 years ago
dgtlmoon fc0fd1ce9d "Extract text" filter - improve placeholder example 3 years ago
dgtlmoon bd6127728a Visual selector - 'clear selection' button should clear the filter also 3 years ago
dgtlmoon 4101ae00c6
New feature - "Extract text" filter ability () 3 years ago
dgtlmoon 62f14df3cb
Fixing RSS feed HTML content formatting () 3 years ago
dgtlmoon 7929aeddfc
'Mark all viewed' button was missing in this version, added test also. () 3 years ago
dgtlmoon 8294519f43 Content fetcher - Handle when a page doesnt load properly 3 years ago
dgtlmoon 8ba8a220b6 Playwright - Correctly close browser context/sessions on exceptions 3 years ago
dgtlmoon aa3c8a9370
Move history data to a textfile, improves memory handling () 3 years ago
dgtlmoon 329c7620fb Remove UK Covid news 3 years ago
Amos (LFlare) Ng 1f974bfbb0
Visual Selector fix: Firefox compatibility - Visual Selector () 3 years ago
Tim Loderhose 437c8525af
Remove group tag arbitrary length limit () 3 years ago
dgtlmoon a2a1d5ae90 Distill.io import bug fix when no tags assigned to a watch () 3 years ago
dgtlmoon 2566de2aae Ignore whitespace on by default 3 years ago