Commit Graph

830 Commits (extract-title-all-processors)

Author SHA1 Message Date
dgtlmoon 946a556fb6
Restock detection - "In stock" should be None/"Not yet checked" by default (#2069)
1 year ago
dgtlmoon eda23678aa Restock detection - updating texts
1 year ago
dgtlmoon 273bd45ad7
Fetching - Custom browser on experimental/puppeteer fetcher - Don't switch to custom puppeteer mode if external browser URL is active (#2068)
1 year ago
dgtlmoon 3d1e1025d2 0.45.9
1 year ago
dgtlmoon 5528b7c4b3 Restock detection - Update stock-not-in-stock.js strings (Dutch translations)
1 year ago
dextouu 792fedb8bc
Restock detection - Update stock-not-in-stock.js strings (#2032)
1 year ago
dgtlmoon 824748df9e API - Updating documentation
1 year ago
dgtlmoon 8e207ba438
API - Ability to add/import bulk list of watches as a line-feed separated list (#2021)
1 year ago
dgtlmoon f0823126c8
Notifications - Fixing support for headers in custom post://, posts:// notifications, ability to include HTTP headers when making custom notifications (#2018)
1 year ago
dgtlmoon 98f56736c1
Improve handling of SIGTERM shutdown in containers, remove unnecessary multi-process handler for pip installs, tidy up modules (#2014)
1 year ago
dgtlmoon 872bd2de85 UI - Extra Browsers - Adding links and more resources on how to connect a fingerprint/scraping browser
1 year ago
dgtlmoon e6de1dd135 0.45.8.1
1 year ago
dgtlmoon 599291645d
PDF Fetcher for change detection - Always use plain requests for PDF because otherwise we cant access the embed PDF in the browser (#2020)
1 year ago
dgtlmoon 156d403552 UI - Fix - Edit Watch 'Show advanced options' should fire at page load to show you whats possible
1 year ago
dgtlmoon 7fe0ef7099 0.45.8
1 year ago
dgtlmoon fe70beeaed Restock detector - adding more detection strings
1 year ago
dgtlmoon abf7ed9085 UI - remove incorrect label
1 year ago
dgtlmoon 19e752e9ba UI - "Add new watch" URL at main input box should always grow to match the viewport
1 year ago
dgtlmoon 684e96f5f1
UI - Tidy-up for advanced settings under watch edit, HTML validation fixes (#2011)
1 year ago
dgtlmoon 8f321139fd UI - 'Request body' section disappears after switching from 'Playwright' to 'System settings default' and back on 'Request' tab - Fixed #1449
1 year ago
dgtlmoon 7fdae82e46 Browser Steps - Adding validation for "Click X,Y" step
1 year ago
dgtlmoon bbc18d8e80
API - Make sure the watch "is viewed" attribute is correctly represented in the API output (#2009)
1 year ago
dgtlmoon d8ee5472f1
Update playwright fetcher library and API calls
1 year ago
dgtlmoon 8fd57280b7
Testing - Improve PDF text change detection tests (#1992)
1 year ago
dgtlmoon 0285d00f13
UI - Clicking the "[Diff]" link should take you to the difference starting at the relative time to when you last viewed the difference page (#1989)
1 year ago
dgtlmoon f7f98945a2
Visual Selector - xPath handling misc fixes (#1976)
1 year ago
dgtlmoon 5e2049c538 Fix build issue
1 year ago
Constantin Hong 26931e0167
feature: Support XPath2.0 to 3.1 (#1774)
1 year ago
dgtlmoon 5229094e44
New functionanlity - Selectable browser / ability to add extra browser connections (good for using "scraping browsers"/ etc) (#1943)
1 year ago
dgtlmoon 5a306aa78c
API/UI - Button to regenerate API key (#1975 / #1967)
1 year ago
dgtlmoon c8dcc072c8
Code refactor for fetchers (#1941)
1 year ago
dgtlmoon 7c97a5a403 0.45.7.3
1 year ago
dgtlmoon 3607d15185 0.45.7.2
1 year ago
dgtlmoon 3382b4cb3f
UI - Cleanup fonts better display in firefox, request CSS according to version (#1968)
1 year ago
dgtlmoon 06975d6d8f 0.45.7.1
1 year ago
dgtlmoon 80f8d23309 0.45.7
1 year ago
dgtlmoon 9f41d15908 UI - Fixing issue where search box JS interfered with page render when logged out
1 year ago
dgtlmoon 89797dfe02 0.45.6
1 year ago
dgtlmoon c905652780
UI - Adding support-us widget <3 (#1956)
1 year ago
dgtlmoon 99246d3e6d
Visual Selector - Small fix, Improving elements fetcher reliability (#1947)
1 year ago
Jai Gupta d3c8386874
Import - Improved Wachete Excel XLS import support for "dynamic wachet" (sets correct state of using chrome browser or not) column (#1934)
1 year ago
dgtlmoon 47103d7f3d
Refactor Excel / wachete import, extend tests (#1931)
1 year ago
dgtlmoon 03c671bfff
Build - Upgrading pip packages (#1915)
1 year ago
dgtlmoon e209d9fba0
Ability to Import from Wachete XLSX (or any XLSX) - Wachete alternative made easy (#1921)
1 year ago
dgtlmoon a0665e1f18 Fetcher - experimental puppeteer fetch - dont rewrite the proxy protocol (fixes socks5 bug)
1 year ago
dgtlmoon 9ffe7e0eaf Nice format stats (comma sep)
1 year ago
dgtlmoon cd1aca9ee3 0.45.5
1 year ago
dgtlmoon 6a589e14f3
BrowserSteps - Wrong text taken from browser steps (#1911)
1 year ago
dgtlmoon dbb76f3618 0.45.4
1 year ago
dgtlmoon 4ae27af511
Code cleanup - Browser Steps
1 year ago
dgtlmoon e1860549dc
Fetching - Browser Step enabled watches should also identify 404/non-200 status situations (#1907)
1 year ago
dgtlmoon 9765d56a23
Text Filters - "Extract Text" filter was not being error checked properly when using a RegEx (#1902)
1 year ago
dgtlmoon 349111eb35
Fetching/BrowserSteps - Going to a page was using slightly logic to the main way - make them use the same methods (#1890)
1 year ago
dgtlmoon 71e50569a0 UI - "With errors" tag/button should always show the current tag error count
1 year ago
Marcelo Alencar 0aef5483d9
Upgrade selenium to 4.14.0 (latest) (#1783)
1 year ago
dgtlmoon c266c64b94
UI - Don't show search icon when logged out (#1896)
1 year ago
dgtlmoon 32e5498a9d
UI - Adding handy "limit to watches with errors" button (#1886)
1 year ago
dgtlmoon 0ba7928d58 UI - Viewing text differences - Tweaks to "Jump to next change" button
1 year ago
dgtlmoon 1709e8f936
UI - BrowserSteps - Show the screenshot of an error if it happened on a step, highlight which step had the error to make it easier to find out why the step didnt work, minor fixes to timeouts(#1883)
1 year ago
dgtlmoon b16d65741c UI - Visual Selector should be the same page-size as Browser Steps (fit inside the browser viewport)
1 year ago
dgtlmoon b58d521d19
UI - Adding [stats] tab to watch Edit page (#1880)
1 year ago
dgtlmoon 52225f2ad8
Bugfix - [Clear history] button was not clearing all metadata (#1881)
1 year ago
dgtlmoon 7220afab0a
RSS fetch - RSS field <title> was not rendering as text correctly, added workaround #1879
1 year ago
dgtlmoon 1c0fe4c23e
PDF Fetching - Handle when the PDF is given as inline content without a proper mime header (#1875)
1 year ago
dgtlmoon f707c914b6
RSS Fetching - Handle CDATA (commented out text) in RSS correctly, generally handle RSS better (#1866)
1 year ago
dgtlmoon 9cb636e638 UI - Adding mouseover/title to show absolute date/time of a last-change or last-checked date #1860
1 year ago
dgtlmoon 1d5fe51157 UI - Difference text viewer - fixing jump to new difference on changing word/line/etc style
1 year ago
dgtlmoon c0b49d3be9 Testing - Improve xPath tests (#1863)
1 year ago
dgtlmoon c4dc85525f UI - Fixing jump to next difference button after refactor
1 year ago
dgtlmoon 26159840c8 UI - Updating proxy tip link
1 year ago
dgtlmoon 522e9786c6
UI - Adding watch label/title to [edit] page title (#1858)
1 year ago
dgtlmoon f9f6300a70 UI - Difference page - added 'title' to each change for nice mouse-over information about when the change occured
1 year ago
dgtlmoon 7734b22a19 UI - Difference page - Tweak 'preview' page invite text
1 year ago
dgtlmoon da421fe110
UI - Ability to select between any difference date ( from / to ) and minor UI cleanup for differences page (#1855)
1 year ago
dgtlmoon 3e2b55a46f UI - Difference page, make the button to find the preview page for triggers and ignored text easier to find
1 year ago
dgtlmoon 7ace259d70
System - No need to run updates on fresh installs (#1854)
1 year ago
dgtlmoon aa6ad7bf47 UI - Proxy configuration helper notes improvements
1 year ago
dgtlmoon 40dd29dbc6
Preview/Difference page - When sharing the preview/difference page, highlight-to-ignore should login should be required (#1852)
1 year ago
dgtlmoon 7debccca73
Fetching - Clarifying how fetchers work with SOCKS5 proxies
1 year ago
dgtlmoon 59578803bf 0.45.3
1 year ago
dgtlmoon ceac8c21e4
LD JSON Price followers - Handle incorrectly created LD-JSON price structures better (#1837)
1 year ago
dgtlmoon 2b948c15c1
Backend - Regular expression / string filtering refactor for Python 3.11 and deprecation warnings since Python 3.6 (#1786)
1 year ago
dgtlmoon 700729a332 UI - BrowserSteps - Browser Steps interface screen should resize relative to the browser
1 year ago
dgtlmoon b6060ac90c BrowserSteps - <input> of type 'number' should use 'enter text in field'
1 year ago
dgtlmoon 5cccccb0b6 Restock detect - bumping texts for restock detection
1 year ago
dgtlmoon c52eb512e8 UI - Proxy Scanner tool should also understand when a filter is empty or contains only an image
1 year ago
dgtlmoon 7282df9c08 UI + Fetching - Improving helper message when filter contains only an image (adding link to more help)
1 year ago
dgtlmoon e30b17b8bc
UI + Fetching - Be more helpful when a filter contains no text, suggest ways to deal with images in filters (#1819)
1 year ago
dgtlmoon 57de4ffe4f
Page fetching - Fixed possible incorrect browser user-agent header in playwright/puppeteer/browserless fetchers (#1811)
1 year ago
dgtlmoon 51e2e8a226
UI - Add extra validation help for notification body with Jinja2 markup (#1810)
1 year ago
dgtlmoon 8887459462 UI - More precise text to describe "current_snapshot" notification token
1 year ago
dgtlmoon 460c724e51 0.45.2
1 year ago
dgtlmoon dcf4bf37ed
Code/Test - Improve testing for creating backups
1 year ago
dgtlmoon e3cf22fc27 UI - Re-order notification field settings
1 year ago
dgtlmoon d497db639e UI - Notifications - Tidyup - Hide the notification tokens but show with a button/link
1 year ago
dgtlmoon 7355ac8d21 UI - Notifications - Tweak discord help text
1 year ago
dgtlmoon 2f2d0ea0f2 RSS feeds - Fixing broken links from RSS index in some environments, refactor code (#152, #148, #1684, #1798)
1 year ago
dgtlmoon a958e1fe20
UI - "recheck all" button should ignore blank/empty "tag" setting when set
1 year ago
dgtlmoon 8ac4757cd9 UI - Fix spelling error
1 year ago
dgtlmoon 2180bb256d UI - Make tgram:// and discord:// examples in notification settings link to how-to pages (#1785)
1 year ago
dgtlmoon 212f15ad5f
Catch possible crash scenario for listing watches - `date_created` was missing on add (#1787)
1 year ago
dgtlmoon 22b2068208
Ability to select "No proxy" for a watch when you have proxy's configured
1 year ago
dgtlmoon 0aa2276afb UI - Fixing update for sort by "date created" or "#" in watch overview table ( #1775 )
1 year ago
Tiago Ilieve 3b875e5a6a
Add 'diff_patch' notification body token - This will allow the diff to be generated in the "unified patch format." (#1765)
1 year ago
dgtlmoon e3c9255d9e 0.45.1
1 year ago
dgtlmoon 3b03bdcb82 UI - Fixing open/broken HTML which was causing some buttons to not display
1 year ago
dgtlmoon e25792bcec 0.45
1 year ago
dgtlmoon bf4168a2aa
Adding Oxylabs proxy recommendation to proxy config page (#1756)
1 year ago
dgtlmoon 9d37eaa57b
Fix - Link in the RSS feed was showing the path twice (when used in reverse proxy)
1 year ago
dgtlmoon 40d01acde9 Fix - Regular Expression text in `ignore` and `trigger` were not processing correctly, also refactored for lower CPU usage (#1747)
1 year ago
dgtlmoon ed4bafae63 UI - "Test notification" button in "Group Tag" settings page was broken due to missing variable #1753
1 year ago
dgtlmoon 3a5bceadfa UI - Clicking 'ignore text' when highlighting text should clear the preview text button/area. #1754
1 year ago
dgtlmoon dee23709a9 0.44.2
1 year ago
dgtlmoon 52df3b10e7
UI - Ability to highlight text and have it offered as a ignore-text option, really nice easy way to set ignores on changing text (#1746)
1 year ago
dgtlmoon a3d8bd0b1a Updating in app links
1 year ago
dgtlmoon 6ef8a1c18f
Updating URL validation library, ability to block access to simple (no dot) hostnames like "localhost" with BLOCK_SIMPLEHOSTS setting (#1732)
1 year ago
dgtlmoon cfa712c88c 0.44.1
1 year ago
dgtlmoon e7f726c057 UI - Fixing darkmode switch icon
1 year ago
dgtlmoon df0cc7b585 0.44
1 year ago
dgtlmoon f84ba0fb31 API - Updating API description for handling a single watch
1 year ago
dgtlmoon 661f7fe32c
Proxy scan improvements - handle custom proxies, dont restart when a scan is already running (#1689)
1 year ago
dgtlmoon 7cb7eebbc5 Browser Steps - When cleaning up old screenshots, check the file exists
1 year ago
dgtlmoon aaceb4ebad Scan/Recheck proxies - Report filter not found as "OK" but with warning
1 year ago
dgtlmoon 56cf6e5ea5
Bug fix - Previously encountered fetch errors were sometimes not being cleared (#1687)
1 year ago
dgtlmoon 1987e109e8
New feature - Helper button to trigger a scan/access test of all proxies for a particular watch (#1685)
1 year ago
dgtlmoon 20d65cdd26 0.43.2
2 years ago
dgtlmoon 37ff5f6d37
Bug - SMTP mailto:// Notification content-type (HTML/Text) fix and add CI tests (#1660)
2 years ago
dgtlmoon 2f777ea3bb
Fix - Watches werent falling back to global default formats correctly when required (#1656)
2 years ago
dgtlmoon e709201955 0.43.1
2 years ago
dgtlmoon 572f71299f
Bug fix - Notification settings were not cascading from global -> tags -> watch correctly in some cases (#1654)
2 years ago
dgtlmoon 5f150c4f03
Bug - Fix watch clone (#1647)
2 years ago
dgtlmoon 8cbf8e8f57
UI - Dont allow empty tag names (#1641)
2 years ago
dgtlmoon 0e65dda5b6 0.43
2 years ago
dgtlmoon 72a415144b UI - Watch Table - Clicking anywhere on the watch list row table also activates the operations buttons and checkbox
2 years ago
dgtlmoon 52f2c00308
UI/Functionality - Ability to manage/apply filters and notifications across tags/groups
2 years ago
Raymond Ha 72311fb845
UI - Fixes to dark mode toggle (#1629)
2 years ago
dgtlmoon a4c620c308
Code - Adding CI test for search (#1626)
2 years ago
dgtlmoon 9434eac72d 0.42.3
2 years ago
dgtlmoon edb5e20de6
Bug fix - Fixed crash when deleting watch from UI when watch was already manually deleted from datadir (#1623)
2 years ago
Maciej Rapacz a4e6fd1ec3
Fetcher / Parser - Automatically attempt to extract JSON from document when document contains JSON but could be wrapped in HTML (#1593)
2 years ago
dgtlmoon d8b9f0fd78
Test improvement - Also test that custom request headers works with Playwright/Browserless (#1607)
2 years ago
dgtlmoon f9387522ee
Fetching - Be sure that content-type detection works when the headers are a mixed case (#1604)
2 years ago
dgtlmoon ba8d2e0c2d
UI/Fetching - Update "Filter not found" message to be more explanatory/helpful (#1602)
2 years ago
dgtlmoon 247db22a33 Restock monitor - Updating texts for tickets available/unavailable restock detection
2 years ago
dgtlmoon e9e1ce893f 0.42.2
2 years ago
dgtlmoon b5a415c7b6
UI - Configurable pager size #1599 #1598
2 years ago
dgtlmoon 9e954532d6
Fetcher - Ability to specify headers from a textfile per watch, global or per tag ( https://github.com/dgtlmoon/changedetection.io/wiki/Adding-headers-from-an-external-file )
2 years ago
dgtlmoon 955835df72
Restock detection - Better reporting when it fails (#1584)
2 years ago
dgtlmoon 1aeafef910
Fetcher - Puppeteer experimental fetcher wasn't returning the status-code (#1585)
2 years ago
dgtlmoon 143971123d 0.42.1
2 years ago
dgtlmoon 04d2d3fb00
Fetcher fix - Clear any fetch error when the fetched document was the same (clear any error that occurred between fetching a document that was the same)
2 years ago
dgtlmoon 236f0c098d 0.42
2 years ago
dgtlmoon 582c6b465b UI - "Search List" also works for 'Title' field
2 years ago
dgtlmoon a021ba87fa UI - New "Search List" icon and functionality (#1580)
2 years ago
dgtlmoon e9057cb851 VisualSelector - Add message when first version cannot be found
2 years ago
dgtlmoon 72ec438caa UI - update link to official project page
2 years ago
dgtlmoon 367dec48e1 BrowserSteps - Dont highlight elements that are the full page width (body, wrappers etc)
2 years ago
dgtlmoon dd87912c88 BrowserSteps - Support for float seconds (0.5 etc)
2 years ago
dgtlmoon 0126cb0aac BrowserSteps - Session keep alive timer countdown fix
2 years ago
dgtlmoon 463b2d0449 BrowserSteps - adding setup check
2 years ago
dgtlmoon e4f6d54ae2 BrowserSteps - Refactored to re-use playwright context which should solve some errors
2 years ago
dgtlmoon 5f338d7824 BrowserSteps - Be sure to select the most appropriate input/button/a when an input element is wrapped in a <div> or other
2 years ago
dgtlmoon 0b563a93ec Fetcher - Experimental fetcher - dont cache embedded data URLs
2 years ago
dgtlmoon d939882dde
Fetcher - Experimental fetcher improvements (Code TidyUp, Improve tests, revert to old playwright when using BrowserSteps for now) (#1564)
2 years ago
dgtlmoon 690cf4acc9 BrowserSteps - Include nice big start button SVG
2 years ago
dgtlmoon 3cb3c7ba2e BrowserSteps - Remove unreliable method for detecting if the element has a "click" listener and default to click (switch to 'Click X,Y' will return the right co-ords anyway)
2 years ago
dgtlmoon 5325918f29
Puppeteer fetcher, adding disk cache and other fixes (#1563)
2 years ago
dgtlmoon 8eee913438 Merge branch 'master' of github.com:dgtlmoon/changedetection.io
2 years ago
dgtlmoon 06921d973e UI - Adding shortcut list select button for "clear/reset history"
2 years ago
dgtlmoon 316f28a0f2
Fetcher - Experimental fetcher fixes, now only enabled with 'USE_EXPERIMENTAL_PUPPETEER_FETCH' env var (default off) (#1561)
2 years ago
dgtlmoon 3801d339f5 UI - Adding shortcut list select button for "clear/reset history"
2 years ago
dgtlmoon d814535dc6 Element scraper - wrap offset detection in try/catch
2 years ago
dgtlmoon cf3f3e4497 BrowserSteps - BrowserSteps was not always following proxy information
2 years ago
dgtlmoon ba76c2a280 BrowserSteps - remove minor delay
2 years ago
dgtlmoon 94f38f052e
Fetcher - playwright/browserless - Use builtin node puppeteer handler in browserless, scales way better, and is faster (#1559)
2 years ago
Raymond Ha 1710885fc4
UI - Fix back navigation / browser history (#1556)
2 years ago
dgtlmoon 2018e73240
UI - HTML validation improvements for edit forms (#1553)
2 years ago
dgtlmoon fae8c89a4e
UI - Various minor HTML validation fixes
2 years ago
dgtlmoon 40988c55c6 UI - pagination - use count including tag filter for pagination display
2 years ago
dgtlmoon 5aa713b7ea UI - Notifications - Adding icon to "Add Email" button
2 years ago
dgtlmoon e1f5dfb703
UI - Adding pagination to watch list (#1549)
2 years ago
dgtlmoon 966600d28e
UI - Set selected watches as 'viewed' (#1550)
2 years ago
dgtlmoon e7ac356d99 UI - Fix missing </span> in watch list when using restock detection
2 years ago
dgtlmoon e874df4ffc
UI - Make sort order and type sticky in cookies, ability to sort by watch created time (#1519)
2 years ago
dgtlmoon d1f44d0345
Notifications - Send test notification should use system defaults for body and title if not set in watch (#1547 #1503)
2 years ago
dgtlmoon 8536af0845 Adding generic changedetection.io SVG icon #1527
2 years ago
dgtlmoon 9076ba6bd3 Tests - error test - be sure to clear results from other test parts
2 years ago
dgtlmoon ad75e8cdd0 Tests - Add test to check that low level fetch errors are cleared on next check
2 years ago
dgtlmoon f604643356 Restock alerts - adding extra detection texts
2 years ago
dgtlmoon d5fd22f693
Restock monitor - Identify the cases where the product is also definitely in stock (#1489)
2 years ago
dgtlmoon bc6bde4062 0.41.1
2 years ago
dgtlmoon ce3966c104 0.41
2 years ago
dgtlmoon d5f574ca17
Notifications - Include triggered text token as `{{triggered_text}}` in notifications, so you can send just the content that matches. (#1485)
2 years ago
dgtlmoon c96ece170a Notification tokens - add comment that the {{tokens}} can be used in the URLs also
2 years ago
dgtlmoon 1fb90bbddc Quick add form - adjust font size and rename stock recheck
2 years ago
dgtlmoon 55b6ae86e8
Ability to set which text to process triggers on (added, removed, changed) according to the difference (#1483)
2 years ago
dgtlmoon 66b892f770 Restock / stock / out of stock monitor - bumping detection texts
2 years ago
dgtlmoon 3b80bb2f0e
Use brotli for reducing the size of the text snapshots (#1482)
2 years ago
dgtlmoon e6d2d87b31
Notification screenshots - now PNG only for now to save disk space (no point creating two images) (#1481)
2 years ago
dgtlmoon 6e71088cde New feature - Restock / stock / out of stock monitor option/mode
2 years ago