Commit Graph

747 Commits (79c6d765de356b000abf7208406032849023c957)

Author SHA1 Message Date
dgtlmoon b6060ac90c BrowserSteps - <input> of type 'number' should use 'enter text in field'
1 year ago
dgtlmoon 5cccccb0b6 Restock detect - bumping texts for restock detection
1 year ago
dgtlmoon c52eb512e8 UI - Proxy Scanner tool should also understand when a filter is empty or contains only an image
1 year ago
dgtlmoon 7282df9c08 UI + Fetching - Improving helper message when filter contains only an image (adding link to more help)
1 year ago
dgtlmoon e30b17b8bc
UI + Fetching - Be more helpful when a filter contains no text, suggest ways to deal with images in filters (#1819)
1 year ago
dgtlmoon 57de4ffe4f
Page fetching - Fixed possible incorrect browser user-agent header in playwright/puppeteer/browserless fetchers (#1811)
1 year ago
dgtlmoon 51e2e8a226
UI - Add extra validation help for notification body with Jinja2 markup (#1810)
1 year ago
dgtlmoon 8887459462 UI - More precise text to describe "current_snapshot" notification token
1 year ago
dgtlmoon 460c724e51 0.45.2
1 year ago
dgtlmoon dcf4bf37ed
Code/Test - Improve testing for creating backups
1 year ago
dgtlmoon e3cf22fc27 UI - Re-order notification field settings
1 year ago
dgtlmoon d497db639e UI - Notifications - Tidyup - Hide the notification tokens but show with a button/link
1 year ago
dgtlmoon 7355ac8d21 UI - Notifications - Tweak discord help text
1 year ago
dgtlmoon 2f2d0ea0f2 RSS feeds - Fixing broken links from RSS index in some environments, refactor code (#152, #148, #1684, #1798)
1 year ago
dgtlmoon a958e1fe20
UI - "recheck all" button should ignore blank/empty "tag" setting when set
1 year ago
dgtlmoon 8ac4757cd9 UI - Fix spelling error
1 year ago
dgtlmoon 2180bb256d UI - Make tgram:// and discord:// examples in notification settings link to how-to pages (#1785)
1 year ago
dgtlmoon 212f15ad5f
Catch possible crash scenario for listing watches - `date_created` was missing on add (#1787)
1 year ago
dgtlmoon 22b2068208
Ability to select "No proxy" for a watch when you have proxy's configured
1 year ago
dgtlmoon 0aa2276afb UI - Fixing update for sort by "date created" or "#" in watch overview table ( #1775 )
1 year ago
Tiago Ilieve 3b875e5a6a
Add 'diff_patch' notification body token - This will allow the diff to be generated in the "unified patch format." (#1765)
1 year ago
dgtlmoon e3c9255d9e 0.45.1
1 year ago
dgtlmoon 3b03bdcb82 UI - Fixing open/broken HTML which was causing some buttons to not display
1 year ago
dgtlmoon e25792bcec 0.45
1 year ago
dgtlmoon bf4168a2aa
Adding Oxylabs proxy recommendation to proxy config page (#1756)
1 year ago
dgtlmoon 9d37eaa57b
Fix - Link in the RSS feed was showing the path twice (when used in reverse proxy)
1 year ago
dgtlmoon 40d01acde9 Fix - Regular Expression text in `ignore` and `trigger` were not processing correctly, also refactored for lower CPU usage (#1747)
1 year ago
dgtlmoon ed4bafae63 UI - "Test notification" button in "Group Tag" settings page was broken due to missing variable #1753
1 year ago
dgtlmoon 3a5bceadfa UI - Clicking 'ignore text' when highlighting text should clear the preview text button/area. #1754
1 year ago
dgtlmoon dee23709a9 0.44.2
1 year ago
dgtlmoon 52df3b10e7
UI - Ability to highlight text and have it offered as a ignore-text option, really nice easy way to set ignores on changing text (#1746)
1 year ago
dgtlmoon a3d8bd0b1a Updating in app links
1 year ago
dgtlmoon 6ef8a1c18f
Updating URL validation library, ability to block access to simple (no dot) hostnames like "localhost" with BLOCK_SIMPLEHOSTS setting (#1732)
1 year ago
dgtlmoon cfa712c88c 0.44.1
1 year ago
dgtlmoon e7f726c057 UI - Fixing darkmode switch icon
1 year ago
dgtlmoon df0cc7b585 0.44
1 year ago
dgtlmoon f84ba0fb31 API - Updating API description for handling a single watch
1 year ago
dgtlmoon 661f7fe32c
Proxy scan improvements - handle custom proxies, dont restart when a scan is already running (#1689)
1 year ago
dgtlmoon 7cb7eebbc5 Browser Steps - When cleaning up old screenshots, check the file exists
1 year ago
dgtlmoon aaceb4ebad Scan/Recheck proxies - Report filter not found as "OK" but with warning
1 year ago
dgtlmoon 56cf6e5ea5
Bug fix - Previously encountered fetch errors were sometimes not being cleared (#1687)
1 year ago
dgtlmoon 1987e109e8
New feature - Helper button to trigger a scan/access test of all proxies for a particular watch (#1685)
1 year ago
dgtlmoon 20d65cdd26 0.43.2
2 years ago
dgtlmoon 37ff5f6d37
Bug - SMTP mailto:// Notification content-type (HTML/Text) fix and add CI tests (#1660)
2 years ago
dgtlmoon 2f777ea3bb
Fix - Watches werent falling back to global default formats correctly when required (#1656)
2 years ago
dgtlmoon e709201955 0.43.1
2 years ago
dgtlmoon 572f71299f
Bug fix - Notification settings were not cascading from global -> tags -> watch correctly in some cases (#1654)
2 years ago
dgtlmoon 5f150c4f03
Bug - Fix watch clone (#1647)
2 years ago
dgtlmoon 8cbf8e8f57
UI - Dont allow empty tag names (#1641)
2 years ago
dgtlmoon 0e65dda5b6 0.43
2 years ago
dgtlmoon 72a415144b UI - Watch Table - Clicking anywhere on the watch list row table also activates the operations buttons and checkbox
2 years ago
dgtlmoon 52f2c00308
UI/Functionality - Ability to manage/apply filters and notifications across tags/groups
2 years ago
Raymond Ha 72311fb845
UI - Fixes to dark mode toggle (#1629)
2 years ago
dgtlmoon a4c620c308
Code - Adding CI test for search (#1626)
2 years ago
dgtlmoon 9434eac72d 0.42.3
2 years ago
dgtlmoon edb5e20de6
Bug fix - Fixed crash when deleting watch from UI when watch was already manually deleted from datadir (#1623)
2 years ago
Maciej Rapacz a4e6fd1ec3
Fetcher / Parser - Automatically attempt to extract JSON from document when document contains JSON but could be wrapped in HTML (#1593)
2 years ago
dgtlmoon d8b9f0fd78
Test improvement - Also test that custom request headers works with Playwright/Browserless (#1607)
2 years ago
dgtlmoon f9387522ee
Fetching - Be sure that content-type detection works when the headers are a mixed case (#1604)
2 years ago
dgtlmoon ba8d2e0c2d
UI/Fetching - Update "Filter not found" message to be more explanatory/helpful (#1602)
2 years ago
dgtlmoon 247db22a33 Restock monitor - Updating texts for tickets available/unavailable restock detection
2 years ago
dgtlmoon e9e1ce893f 0.42.2
2 years ago
dgtlmoon b5a415c7b6
UI - Configurable pager size #1599 #1598
2 years ago
dgtlmoon 9e954532d6
Fetcher - Ability to specify headers from a textfile per watch, global or per tag ( https://github.com/dgtlmoon/changedetection.io/wiki/Adding-headers-from-an-external-file )
2 years ago
dgtlmoon 955835df72
Restock detection - Better reporting when it fails (#1584)
2 years ago
dgtlmoon 1aeafef910
Fetcher - Puppeteer experimental fetcher wasn't returning the status-code (#1585)
2 years ago
dgtlmoon 143971123d 0.42.1
2 years ago
dgtlmoon 04d2d3fb00
Fetcher fix - Clear any fetch error when the fetched document was the same (clear any error that occurred between fetching a document that was the same)
2 years ago
dgtlmoon 236f0c098d 0.42
2 years ago
dgtlmoon 582c6b465b UI - "Search List" also works for 'Title' field
2 years ago
dgtlmoon a021ba87fa UI - New "Search List" icon and functionality (#1580)
2 years ago
dgtlmoon e9057cb851 VisualSelector - Add message when first version cannot be found
2 years ago
dgtlmoon 72ec438caa UI - update link to official project page
2 years ago
dgtlmoon 367dec48e1 BrowserSteps - Dont highlight elements that are the full page width (body, wrappers etc)
2 years ago
dgtlmoon dd87912c88 BrowserSteps - Support for float seconds (0.5 etc)
2 years ago
dgtlmoon 0126cb0aac BrowserSteps - Session keep alive timer countdown fix
2 years ago
dgtlmoon 463b2d0449 BrowserSteps - adding setup check
2 years ago
dgtlmoon e4f6d54ae2 BrowserSteps - Refactored to re-use playwright context which should solve some errors
2 years ago
dgtlmoon 5f338d7824 BrowserSteps - Be sure to select the most appropriate input/button/a when an input element is wrapped in a <div> or other
2 years ago
dgtlmoon 0b563a93ec Fetcher - Experimental fetcher - dont cache embedded data URLs
2 years ago
dgtlmoon d939882dde
Fetcher - Experimental fetcher improvements (Code TidyUp, Improve tests, revert to old playwright when using BrowserSteps for now) (#1564)
2 years ago
dgtlmoon 690cf4acc9 BrowserSteps - Include nice big start button SVG
2 years ago
dgtlmoon 3cb3c7ba2e BrowserSteps - Remove unreliable method for detecting if the element has a "click" listener and default to click (switch to 'Click X,Y' will return the right co-ords anyway)
2 years ago
dgtlmoon 5325918f29
Puppeteer fetcher, adding disk cache and other fixes (#1563)
2 years ago
dgtlmoon 8eee913438 Merge branch 'master' of github.com:dgtlmoon/changedetection.io
2 years ago
dgtlmoon 06921d973e UI - Adding shortcut list select button for "clear/reset history"
2 years ago
dgtlmoon 316f28a0f2
Fetcher - Experimental fetcher fixes, now only enabled with 'USE_EXPERIMENTAL_PUPPETEER_FETCH' env var (default off) (#1561)
2 years ago
dgtlmoon 3801d339f5 UI - Adding shortcut list select button for "clear/reset history"
2 years ago
dgtlmoon d814535dc6 Element scraper - wrap offset detection in try/catch
2 years ago
dgtlmoon cf3f3e4497 BrowserSteps - BrowserSteps was not always following proxy information
2 years ago
dgtlmoon ba76c2a280 BrowserSteps - remove minor delay
2 years ago
dgtlmoon 94f38f052e
Fetcher - playwright/browserless - Use builtin node puppeteer handler in browserless, scales way better, and is faster (#1559)
2 years ago
Raymond Ha 1710885fc4
UI - Fix back navigation / browser history (#1556)
2 years ago
dgtlmoon 2018e73240
UI - HTML validation improvements for edit forms (#1553)
2 years ago
dgtlmoon fae8c89a4e
UI - Various minor HTML validation fixes
2 years ago
dgtlmoon 40988c55c6 UI - pagination - use count including tag filter for pagination display
2 years ago
dgtlmoon 5aa713b7ea UI - Notifications - Adding icon to "Add Email" button
2 years ago
dgtlmoon e1f5dfb703
UI - Adding pagination to watch list (#1549)
2 years ago
dgtlmoon 966600d28e
UI - Set selected watches as 'viewed' (#1550)
2 years ago
dgtlmoon e7ac356d99 UI - Fix missing </span> in watch list when using restock detection
2 years ago
dgtlmoon e874df4ffc
UI - Make sort order and type sticky in cookies, ability to sort by watch created time (#1519)
2 years ago
dgtlmoon d1f44d0345
Notifications - Send test notification should use system defaults for body and title if not set in watch (#1547 #1503)
2 years ago
dgtlmoon 8536af0845 Adding generic changedetection.io SVG icon #1527
2 years ago
dgtlmoon 9076ba6bd3 Tests - error test - be sure to clear results from other test parts
2 years ago
dgtlmoon ad75e8cdd0 Tests - Add test to check that low level fetch errors are cleared on next check
2 years ago
dgtlmoon f604643356 Restock alerts - adding extra detection texts
2 years ago
dgtlmoon d5fd22f693
Restock monitor - Identify the cases where the product is also definitely in stock (#1489)
2 years ago
dgtlmoon bc6bde4062 0.41.1
2 years ago
dgtlmoon ce3966c104 0.41
2 years ago
dgtlmoon d5f574ca17
Notifications - Include triggered text token as `{{triggered_text}}` in notifications, so you can send just the content that matches. (#1485)
2 years ago
dgtlmoon c96ece170a Notification tokens - add comment that the {{tokens}} can be used in the URLs also
2 years ago
dgtlmoon 1fb90bbddc Quick add form - adjust font size and rename stock recheck
2 years ago
dgtlmoon 55b6ae86e8
Ability to set which text to process triggers on (added, removed, changed) according to the difference (#1483)
2 years ago
dgtlmoon 66b892f770 Restock / stock / out of stock monitor - bumping detection texts
2 years ago
dgtlmoon 3b80bb2f0e
Use brotli for reducing the size of the text snapshots (#1482)
2 years ago
dgtlmoon e6d2d87b31
Notification screenshots - now PNG only for now to save disk space (no point creating two images) (#1481)
2 years ago
dgtlmoon 6e71088cde New feature - Restock / stock / out of stock monitor option/mode
2 years ago
dgtlmoon 2bc988dffc UI - Clone/copy watch - A paused watch should not be checked when copied/cloned #1471.
2 years ago
dgtlmoon 4c74d39df0
Code - Abstract out the diff fetch types to make it easier to integrate new ones (#1467)
2 years ago
dgtlmoon c454cbb808
BrowserSteps - Adding `Goto URL` step
2 years ago
dgtlmoon 6f1eec0d5a
Fixing bad linebreak definition `</br>` in notifications and UI (#1465)
2 years ago
reecespieces 0d05ee1586
Notification Improvements - New tokens `{{diff_added}}` and `{{diff_removed}}`, removed whitespace around `added` and `into` ( Issue #905 ) (#1454)
2 years ago
dgtlmoon cf363971c1
Bug - False change alerts - code cleanups Re #962 (#1444)
2 years ago
dgtlmoon fc88306805
Be sure that `process_changedetection_results` is off after PageUnloadable and EmptyReply exceptions from fetcher - Re #962 (#1439)
2 years ago
dgtlmoon 8253074d56
False change alerts fix - Don't reset watch checksum when a fetch error happens, adjust test to not test for fluctuating filter (#1437)
2 years ago
dgtlmoon abf234298c
API - Including `last_changed` timestamp in watch API info (#1436)
2 years ago
dgtlmoon 3b96e40464 API documentation - improving example for list watches
2 years ago
dgtlmoon c747cf7ba8 API documentation - improving example for snapshot history
2 years ago
dgtlmoon 3e98c8ae4b API - Adding current version to 'System Information' endpoint, bumping API docs, Re #1429
2 years ago
dgtlmoon aaad71fc19 Further improving API documentation Re #1426
2 years ago
dgtlmoon 78f93113d8 Improving API documentation Re #1426
2 years ago
dgtlmoon e9e586205a Browser Steps - Adding "Wait for text" and "Wait for text in element" Re #1427
2 years ago
dgtlmoon 89f1ba58b6 Re #1382 - UI fix - sorting now works with selected tag
2 years ago
dgtlmoon 6f4fd011e3
Dont rewrite/resave snapshot when its the same data, just bump the history index, saves disk space. (#1414)
2 years ago
dgtlmoon 900dc5ee78
Fetching - False alerts issue #962 - be sure to avoid triggering changedetection when checksums were the same (#1410)
2 years ago
dgtlmoon 7b8b50138b
Deleting a watch now removes the entire watch storage directory (#1408)
2 years ago
dgtlmoon 01af21f856 Use year/date in the backup snapshot zip filename instead of epoch seconds (#1377 #1407)
2 years ago
dgtlmoon f7f4ab314b
PDF text conversion - fix bug where it detected a site as a PDF file incorrectly Re #1392 #1393
2 years ago
dgtlmoon ce0355c0ad
Remove unused code (#1394)
2 years ago
dgtlmoon 0f43213d9d UI - preview page - Fix bug where playwright/chrome was system default and [preview] didnt show snapshot
2 years ago
dgtlmoon 3cdd075baf 0.40.2
2 years ago
dgtlmoon 5c617e8530 Code cleanup - remove unused import
2 years ago
dgtlmoon 1a48965ba1
UI fix - Fix logic for showing screenshot on diff page (#1379)
2 years ago
dgtlmoon 41856c4ed8
Re #1365 - Playwright - Browser "Service Workers" should be enabled by default but unset via env var PLAYWRIGHT_SERVICE_WORKERS=block (#1367)
2 years ago
dgtlmoon 0ed897c50f
New setting to allow passwordless access to your 'diff' page - perfect for sharing your diff page securely, refactored login code (#1357)
2 years ago
dgtlmoon f8e587c415
Security - Possible stored XSS in watch list - Only permit HTTP/HTTP/FTP by default - override with env var `SAFE_PROTOCOL_REGEX` (#1359)
2 years ago
dgtlmoon d47a25eb6d
Playwright - Removing old bug fix where playwright needed screenshot called twice to make the full screen screenshot be actually fullscreen (#1356)
2 years ago
dgtlmoon 9a0792d185
Fetch backend UI default fixes for VisualSelector and BrowserSteps (#1344)
2 years ago
dgtlmoon 948ef7ade4
Fix fetch UI default fetch backend option icon (#1343)
2 years ago
dgtlmoon a9431191fc 0.40.1.1
2 years ago
dgtlmoon 774451f256
Re #1328 - add `-6` flag to enable IPv6 (#1329)
2 years ago
dgtlmoon 04577cbf32 0.40.1.0
2 years ago
dgtlmoon 7048a0acbd
UI - Fix wrong logic when dealing with webdriver/playwright watch screenshot settings (#1325)
2 years ago
dgtlmoon fba719ab8d Ability for watch to use a more obvious system default fetcher (#1320)
2 years ago
dgtlmoon de15dfd80d
Reliability fix - Remove loop that could cause app to stop checking if data changes (#1313)
2 years ago
dgtlmoon 024c8d8fd5
API - Improvements, support PUT for updating existing watch, set muted state, set paused state, see https://changedetection.io/docs/api_v1/index.html (#1213)
2 years ago
dgtlmoon fab7d325f7
Data storage - Don't recreate DB if its corrupt, exit with error cleanly so operator can look into the problem (#1296)
2 years ago
jtagcat 58c7cbeac7
UI: Updating queued success message (#1285)
2 years ago
dgtlmoon 50805ca38a
IPv6 support for listening on (#1267)
2 years ago
dgtlmoon fc6424c39e
Test improvements (#1264)
2 years ago
dgtlmoon f0966eb23a 0.40.0.4
2 years ago
dgtlmoon e4fb5ab4da
UI - Suggest adding proxy for watch when 403 access denied is reached (#1260)
2 years ago
dgtlmoon e99f07a51d
Filters & Notifications - fixed tokens in filter not found notification
2 years ago
dgtlmoon 08ee223b5f UI - Fix broken html tags in settings page
2 years ago
dgtlmoon 572f9b8a31 Proxy Settings in UI - TidyUp BrightData text
2 years ago
dgtlmoon fcfd1b5e10
Ability to configure extra proxies via the UI (#1235)
2 years ago
dgtlmoon 0790dd555e
Docker container updates - use Python 3.10, remove unused packages
2 years ago
dgtlmoon 0b20dc7712
Tidy up list icons a bit (#1250)
2 years ago
dgtlmoon 13c4121f52
PDF File change detection - Initial PDF fetcher support with basic text extraction (#1244)
2 years ago
dgtlmoon e8e176f3bd
Testing - Run test as fully built docker container (#1245)
2 years ago
dgtlmoon 7a1d2d924e Dark mode - system setting var is not required (its cookie based)
2 years ago
dgtlmoon c3731cf055 0.40.0.3
2 years ago
dgtlmoon a287e5a86c
Visual Selector - Select smallest/most precise element first, better filtering of zero size elements
2 years ago
dgtlmoon 235535c327
Fetching - Check the most overdue watch first (#1242)
2 years ago
dgtlmoon 44dc62da2d Overview list - Checkbox action "Recheck"
2 years ago
dgtlmoon 0c380c170f
Playwright - Better error reporting and re-try fetch on fail once (#1238)
2 years ago
dgtlmoon b7a2501d64
Fetching - Always sort the key order of JSON content for less false alerts (May cause an alert on upgrade, but will be better going forwards) #1219
2 years ago
dgtlmoon e970fef991
Fetcher + VisualSelector - xPath filter with attribute filter was breaking the element finder
2 years ago
dgtlmoon b76148a0f4
Fetcher - CPU usage - Skip processing if the previous checksum and the just fetched one was the same (#925)
2 years ago
dgtlmoon 93cc30437f
Playwright+BrowserSteps - Fetch changes - Fetch simply after page starts rendering + delay seconds, disable service workers
2 years ago
dgtlmoon f30cdf0674 0.40.0.2
2 years ago
dgtlmoon 14da0646a7
Price follower - Dont scan for ldjson data when 'no' was clicked on the suggestion (#1207)
2 years ago
dgtlmoon b413cdecc7 Adding missing parts for pip build Re #1206
2 years ago
dgtlmoon 7bf52d9275 0.40.0
2 years ago
dgtlmoon 09e6624afd VisualSelector - Exclude items that are not interactable or visible
2 years ago
dgtlmoon b58fd995b5 Automatically offer to track LD+JSON product price data (#1204)
2 years ago
dgtlmoon f7bb8a0afa UI - favicon callback no longer needed
2 years ago
dgtlmoon 3e333496c1
Test cleanups (#1196)
2 years ago
dgtlmoon 65db4d68e3
Dark mode - HTML template tidy up (#1197)
2 years ago
dgtlmoon 74d93d10c3 UI - watch tags also known as watch tag / label
2 years ago
dgtlmoon 37aef0530a Notification templates - bug in update, was updating the main system instead of the watch notification_title incorrectly
2 years ago
dgtlmoon f86763dc7a Extract data - minor improvement to example
2 years ago
dgtlmoon 13c25f9b92 Darkmode - Pause/Mute notification colour fix, re #1195
2 years ago
dgtlmoon 265f622e75
Notification - Support for standard API calls post:// posts:// get:// gets:// delete:// deletes:// put:// puts:// (#1194)
2 years ago
dgtlmoon c12db2b725
Notifications - tokens/jinja2 templating (#1184)
2 years ago
dgtlmoon a048e4a02d Dark mode - more colour fixes
2 years ago
dgtlmoon 69662ff91c
Test improvement - improving notification error network test
2 years ago
dgtlmoon fc94c57d7f
Extract text as CSV - Extra validation (#1192)
2 years ago
dgtlmoon 7b94ba6f23 Dark mode - make watch list easier to read when theres 'unviewed' entries
2 years ago
dgtlmoon 2345b6b558
New feature - Simple extract data by regex from all historical watch text into CSV (#1191)
2 years ago