Commit Graph

575 Commits (3b03bdcb82a8f19a92d2e1aeb53d17d7fe3b3dfc)

Author SHA1 Message Date
dgtlmoon cf363971c1
Bug - False change alerts - code cleanups Re #962 (#1444)
2 years ago
dgtlmoon fc88306805
Be sure that `process_changedetection_results` is off after PageUnloadable and EmptyReply exceptions from fetcher - Re #962 (#1439)
2 years ago
dgtlmoon 8253074d56
False change alerts fix - Don't reset watch checksum when a fetch error happens, adjust test to not test for fluctuating filter (#1437)
2 years ago
dgtlmoon abf234298c
API - Including `last_changed` timestamp in watch API info (#1436)
2 years ago
dgtlmoon 3b96e40464 API documentation - improving example for list watches
2 years ago
dgtlmoon c747cf7ba8 API documentation - improving example for snapshot history
2 years ago
dgtlmoon 3e98c8ae4b API - Adding current version to 'System Information' endpoint, bumping API docs, Re #1429
2 years ago
dgtlmoon aaad71fc19 Further improving API documentation Re #1426
2 years ago
dgtlmoon 78f93113d8 Improving API documentation Re #1426
2 years ago
dgtlmoon e9e586205a Browser Steps - Adding "Wait for text" and "Wait for text in element" Re #1427
2 years ago
dgtlmoon 89f1ba58b6 Re #1382 - UI fix - sorting now works with selected tag
2 years ago
dgtlmoon 6f4fd011e3
Dont rewrite/resave snapshot when its the same data, just bump the history index, saves disk space. (#1414)
2 years ago
dgtlmoon 900dc5ee78
Fetching - False alerts issue #962 - be sure to avoid triggering changedetection when checksums were the same (#1410)
2 years ago
dgtlmoon 7b8b50138b
Deleting a watch now removes the entire watch storage directory (#1408)
2 years ago
dgtlmoon 01af21f856 Use year/date in the backup snapshot zip filename instead of epoch seconds (#1377 #1407)
2 years ago
dgtlmoon f7f4ab314b
PDF text conversion - fix bug where it detected a site as a PDF file incorrectly Re #1392 #1393
2 years ago
dgtlmoon ce0355c0ad
Remove unused code (#1394)
2 years ago
dgtlmoon 0f43213d9d UI - preview page - Fix bug where playwright/chrome was system default and [preview] didnt show snapshot
2 years ago
dgtlmoon 3cdd075baf 0.40.2
2 years ago
dgtlmoon 5c617e8530 Code cleanup - remove unused import
2 years ago
dgtlmoon 1a48965ba1
UI fix - Fix logic for showing screenshot on diff page (#1379)
2 years ago
dgtlmoon 41856c4ed8
Re #1365 - Playwright - Browser "Service Workers" should be enabled by default but unset via env var PLAYWRIGHT_SERVICE_WORKERS=block (#1367)
2 years ago
dgtlmoon 0ed897c50f
New setting to allow passwordless access to your 'diff' page - perfect for sharing your diff page securely, refactored login code (#1357)
2 years ago
dgtlmoon f8e587c415
Security - Possible stored XSS in watch list - Only permit HTTP/HTTP/FTP by default - override with env var `SAFE_PROTOCOL_REGEX` (#1359)
2 years ago
dgtlmoon d47a25eb6d
Playwright - Removing old bug fix where playwright needed screenshot called twice to make the full screen screenshot be actually fullscreen (#1356)
2 years ago
dgtlmoon 9a0792d185
Fetch backend UI default fixes for VisualSelector and BrowserSteps (#1344)
2 years ago
dgtlmoon 948ef7ade4
Fix fetch UI default fetch backend option icon (#1343)
2 years ago
dgtlmoon a9431191fc 0.40.1.1
2 years ago
dgtlmoon 774451f256
Re #1328 - add `-6` flag to enable IPv6 (#1329)
2 years ago
dgtlmoon 04577cbf32 0.40.1.0
2 years ago
dgtlmoon 7048a0acbd
UI - Fix wrong logic when dealing with webdriver/playwright watch screenshot settings (#1325)
2 years ago
dgtlmoon fba719ab8d Ability for watch to use a more obvious system default fetcher (#1320)
2 years ago
dgtlmoon de15dfd80d
Reliability fix - Remove loop that could cause app to stop checking if data changes (#1313)
2 years ago
dgtlmoon 024c8d8fd5
API - Improvements, support PUT for updating existing watch, set muted state, set paused state, see https://changedetection.io/docs/api_v1/index.html (#1213)
2 years ago
dgtlmoon fab7d325f7
Data storage - Don't recreate DB if its corrupt, exit with error cleanly so operator can look into the problem (#1296)
2 years ago
jtagcat 58c7cbeac7
UI: Updating queued success message (#1285)
2 years ago
dgtlmoon 50805ca38a
IPv6 support for listening on (#1267)
2 years ago
dgtlmoon fc6424c39e
Test improvements (#1264)
2 years ago
dgtlmoon f0966eb23a 0.40.0.4
2 years ago
dgtlmoon e4fb5ab4da
UI - Suggest adding proxy for watch when 403 access denied is reached (#1260)
2 years ago
dgtlmoon e99f07a51d
Filters & Notifications - fixed tokens in filter not found notification
2 years ago
dgtlmoon 08ee223b5f UI - Fix broken html tags in settings page
2 years ago
dgtlmoon 572f9b8a31 Proxy Settings in UI - TidyUp BrightData text
2 years ago
dgtlmoon fcfd1b5e10
Ability to configure extra proxies via the UI (#1235)
2 years ago
dgtlmoon 0790dd555e
Docker container updates - use Python 3.10, remove unused packages
2 years ago
dgtlmoon 0b20dc7712
Tidy up list icons a bit (#1250)
2 years ago
dgtlmoon 13c4121f52
PDF File change detection - Initial PDF fetcher support with basic text extraction (#1244)
2 years ago
dgtlmoon e8e176f3bd
Testing - Run test as fully built docker container (#1245)
2 years ago
dgtlmoon 7a1d2d924e Dark mode - system setting var is not required (its cookie based)
2 years ago
dgtlmoon c3731cf055 0.40.0.3
2 years ago
dgtlmoon a287e5a86c
Visual Selector - Select smallest/most precise element first, better filtering of zero size elements
2 years ago
dgtlmoon 235535c327
Fetching - Check the most overdue watch first (#1242)
2 years ago
dgtlmoon 44dc62da2d Overview list - Checkbox action "Recheck"
2 years ago
dgtlmoon 0c380c170f
Playwright - Better error reporting and re-try fetch on fail once (#1238)
2 years ago
dgtlmoon b7a2501d64
Fetching - Always sort the key order of JSON content for less false alerts (May cause an alert on upgrade, but will be better going forwards) #1219
2 years ago
dgtlmoon e970fef991
Fetcher + VisualSelector - xPath filter with attribute filter was breaking the element finder
2 years ago
dgtlmoon b76148a0f4
Fetcher - CPU usage - Skip processing if the previous checksum and the just fetched one was the same (#925)
2 years ago
dgtlmoon 93cc30437f
Playwright+BrowserSteps - Fetch changes - Fetch simply after page starts rendering + delay seconds, disable service workers
2 years ago
dgtlmoon f30cdf0674 0.40.0.2
2 years ago
dgtlmoon 14da0646a7
Price follower - Dont scan for ldjson data when 'no' was clicked on the suggestion (#1207)
2 years ago
dgtlmoon b413cdecc7 Adding missing parts for pip build Re #1206
2 years ago
dgtlmoon 7bf52d9275 0.40.0
2 years ago
dgtlmoon 09e6624afd VisualSelector - Exclude items that are not interactable or visible
2 years ago
dgtlmoon b58fd995b5 Automatically offer to track LD+JSON product price data (#1204)
2 years ago
dgtlmoon f7bb8a0afa UI - favicon callback no longer needed
2 years ago
dgtlmoon 3e333496c1
Test cleanups (#1196)
2 years ago
dgtlmoon 65db4d68e3
Dark mode - HTML template tidy up (#1197)
2 years ago
dgtlmoon 74d93d10c3 UI - watch tags also known as watch tag / label
2 years ago
dgtlmoon 37aef0530a Notification templates - bug in update, was updating the main system instead of the watch notification_title incorrectly
2 years ago
dgtlmoon f86763dc7a Extract data - minor improvement to example
2 years ago
dgtlmoon 13c25f9b92 Darkmode - Pause/Mute notification colour fix, re #1195
2 years ago
dgtlmoon 265f622e75
Notification - Support for standard API calls post:// posts:// get:// gets:// delete:// deletes:// put:// puts:// (#1194)
2 years ago
dgtlmoon c12db2b725
Notifications - tokens/jinja2 templating (#1184)
2 years ago
dgtlmoon a048e4a02d Dark mode - more colour fixes
2 years ago
dgtlmoon 69662ff91c
Test improvement - improving notification error network test
2 years ago
dgtlmoon fc94c57d7f
Extract text as CSV - Extra validation (#1192)
2 years ago
dgtlmoon 7b94ba6f23 Dark mode - make watch list easier to read when theres 'unviewed' entries
2 years ago
dgtlmoon 2345b6b558
New feature - Simple extract data by regex from all historical watch text into CSV (#1191)
2 years ago
dgtlmoon b8d5a12ad0 UI - Cursor over labels should be pointer
2 years ago
dgtlmoon 9e67a572c5 Dark mode - Make watches with errors easier to read
2 years ago
dgtlmoon 378d7b7362 Dark mode - cookie path should be all site
2 years ago
dgtlmoon d1d4045c49 Tweaks - adding hover/title to dark mode button
2 years ago
dgtlmoon 77409eeb3a UI - Dark Mode (#1187)
2 years ago
dgtlmoon 72222158e9 BrowserSteps - Can be shared by the watch share link
2 years ago
dgtlmoon 1814924c19 Merge branch 'master' of github.com:dgtlmoon/changedetection.io
2 years ago
dgtlmoon 8aae4197d7 UI - Make tabs hoverable
2 years ago
dgtlmoon 3a8a41a3ff
Favicon multiplatform and path fix/update (#1176)
2 years ago
dgtlmoon 64caeea491 BrowserSteps - Cleanup interface on shutdown
2 years ago
dgtlmoon 3838bff397 BrowserSteps - More work on cleaner shutdowns of browser session
2 years ago
dgtlmoon 55ea983bda BrowserSteps - Forcefully shutdown playwright to prevent any race-conditions waiting for it to shutdown
2 years ago
dgtlmoon b4d79839bf
BrowserSteps - Make the UI require an extra step so it doesnt slow down the experience when clicking through the tabs (#1175)
2 years ago
dgtlmoon 0b8c3add34 BrowserSteps - Use correct mimetype for screenshot update
2 years ago
dgtlmoon 51d57f0963
BrowserSteps - Faster screenshot updates and enable gzip compression for all content replies in the UI (#1171)
2 years ago
dgtlmoon 6d932149e3 BrowserSteps - Add 'Execute JS' step
2 years ago
dgtlmoon 2c764e8f84 BrowserSteps - Also try to find clickable div/spans
2 years ago
dgtlmoon 4624974b91 BrowserSteps - Element finder filter (offpage) should also calculate top scroll offset
2 years ago
dgtlmoon 991841f1f9 Visual Selector and BrowserSteps - More accurate element detection when the page auto-scrolls on load Re #1169
2 years ago
dgtlmoon e3db324698
Extra validation for URLs with template markup (#1166)
2 years ago
dgtlmoon 0988bef2cd Browser Steps - adding 'please wait' text while loading
2 years ago
dgtlmoon 69756f20f2 VisualSelector & BrowserSteps - Scraper improvements, remove duplicate code
2 years ago
dgtlmoon fde7b3fd97 Remove dupe xpath finder prep code
2 years ago
dgtlmoon 9d04cb014a Browsersteps 'Beta' label image path fix
2 years ago
dgtlmoon 5b530ff61c
Configurable "Browser Steps" when Playwright/Chrome is configured (enter text, scroll, wait for text, click button etc) (#478)
2 years ago
dgtlmoon 463747d3b7 0.39.22.1
2 years ago
dgtlmoon ce6c2737a8
Notification screenshot/JPEG was not being regenerated correctly (#1149)
2 years ago
dgtlmoon 943704cd04 0.39.22
2 years ago
dgtlmoon 883561f979 Fix dangling HTML tag from screenshot notification
2 years ago
dgtlmoon 35d44c8277
Notification screenshot option should only be available to webdriver/playwright watches, screenshot sent as JPEG to save bandwidth, Simplify the logic around screenshot, (#1140)
2 years ago
dgtlmoon d07d7a1b18
Minor test improvements
2 years ago
Matthias Bilger f066a1c38f
Option to attach screenshot to notification (#1127)
2 years ago
dgtlmoon d0d191a7d1 VisualFilter - check previously set filters were set before highlighting
2 years ago
dgtlmoon d7482c8d6a Add diff view option for JSON compare (comparing the fields defined on each. The order of fields, etc does not matter in this comparison.)
2 years ago
dgtlmoon bcf7417f63
Update visual text difference library, add option to ignore whitespace when viewing diff (#1137)
2 years ago
dgtlmoon df6e835035
Make VisualSelector show first available multiple selector, refactor to make more maintainable (#1132)
2 years ago
dgtlmoon ab28f20eba
Make link to notification debug log easier to find (#1130)
2 years ago
dgtlmoon a564475325 Re #1126 HIDE_REFERER setting had wrong default
2 years ago
dgtlmoon 85d8d57997
Test: Re-test under HIDE_REFERER condition, use strtobool so you can use 'False' (#1121)
2 years ago
dgtlmoon 359dcb63e3
Stability fix related to the new watch check count (#1113)
2 years ago
dgtlmoon b043d477dc
Use deepcopy to stop possible data corruption (#1108)
2 years ago
dgtlmoon 06bcfb28e5 Code- Use dict .get instead of key
2 years ago
dgtlmoon ca3b351bae
Adding a check counter to watch fetching (#1099)
2 years ago
dgtlmoon 61f0ac2937 HIDE_REFERER incompatible with password based login, added comment to code #996
2 years ago
dgtlmoon 359fc48fb4
Filters can now accept a list/multiple filters (#1064) #623
2 years ago
dgtlmoon d0efeb9770 0.39.21.1
2 years ago
dgtlmoon 3416532cd6
Playwright extension added back to Dockerfile to resolve conditional fix Alpine (musl) based systems (#1087)
2 years ago
dgtlmoon defc7a340e 0.39.21
2 years ago
dgtlmoon c197c062e1
Disable version check when pytest is running (#1084)
2 years ago
dgtlmoon 77b59809ca
Removing unused code (#1070)
2 years ago
dgtlmoon f90b170e68
Docker & python - Jq conditional pip requirements.txt include (Don't install in Windows because theres no Windows library/wheel)
2 years ago
dgtlmoon c93ca1841c
Docker & python - Use pip conditional requirements to not install playwright for ARM (unsupported on ARM) (#1067)
2 years ago
Sandro 57f604dff1
UI - Make fetch error more readable (#1038)
2 years ago
dgtlmoon 7f6a13ea6c
Re #1052 - Watch 'open' link should use any dynamic/template info (#1063)
2 years ago
dgtlmoon 9874f0cbc7 Remove accidental files
2 years ago
dgtlmoon 72834a42fd
Backups and Snapshots - Data directory now fully portable, (all paths are relative) , refactored backup zip export creation
2 years ago
dgtlmoon 724cb17224
Re #1052 - Dynamic URLs, use variables in the URL (such as the current date, the date in a month, and other logic see https://github.com/dgtlmoon/changedetection.io/wiki/Handling-variables-in-the-watched-URL ) (#1057)
2 years ago
dgtlmoon 4eb4b401a1 API - system info - allow 5 minutes grace before watch is considered 'overdue'
2 years ago
dgtlmoon 5d40e16c73
API - Adding basic system info/system state API (#1051)
2 years ago
Entepotenz 7839551d6b
Testing - Use same version of playwright while running tests as in production builds (#1047)
2 years ago
dgtlmoon 5a43a350de
History index safety check - Be sure that only valid history index lines are read (#1042)
2 years ago
Michael McMillan 3c31f023ce
Option to Hide the Referer header from monitored websites. (#996)
2 years ago
dgtlmoon 4cbcc59461 0.39.20.4
2 years ago
dgtlmoon 4be0260381
Better cross platform file handling in diff and preview (#1034)
2 years ago
dgtlmoon 957a3c1c16 0.39.20.3
2 years ago
dgtlmoon 85897e0bf9
Windows - diff file handling improvements (#1031)
2 years ago
dgtlmoon 1b077abd93 0.39.20.2
2 years ago
dgtlmoon 32ea1a8721
Windows - JQ - Make library optional so it doesnt break Windows pip installs (#1009)
2 years ago
dgtlmoon fff32cef0d
Adding test - Test the 'execute JS before changedetection' (#1006)
2 years ago
dgtlmoon 8fb146f3e4 0.39.20.1
2 years ago
dgtlmoon 669fd3ae0b
Dont use default Requests `user-agent` and `accept` headers in playwright+selenium requests, breaks sites such as united.com. (#1004)
2 years ago
dgtlmoon 17d37fb626 0.39.20
2 years ago