Commit Graph

891 Commits (54a4970a4c5c3b518d97145609cbc53df63ce886)

Author SHA1 Message Date
dgtlmoon 14e632bc19
Custom headers fix in Browser Steps and Playwright/Puppeteer fetchers ( #2197 )
10 months ago
Constantin Hong 52c895b2e8
text_json_diff/fix: Keep an order of filter and remove duplicated filters. 2 (#2178)
10 months ago
dgtlmoon a62043e086
Fetching - restock detecting and visual selector scraper - Fixes scraping of elements that are not visible
10 months ago
dgtlmoon 3d390b6ea4 BrowserSteps UI - Avoid selecting very large elements that are likely to be the page wrapper
10 months ago
dgtlmoon 301a40ca34 Fetching - Puppeteer - Adding more debug/diagnostic information
10 months ago
dgtlmoon 1c099cdba6
Update stock-not-in-stock.js
10 months ago
dgtlmoon af747e6e3f
UI - Sorted alphabetical tag list and list of tags in groups setting (#2205)
10 months ago
dgtlmoon aefad0bdf6 Code - Remove whitespaces in visual selector elements config
10 months ago
dgtlmoon 904ef84f82
Build fix - Pinning package versions and Custom browser endpoints should not have a proxy set (#2204)
10 months ago
dgtlmoon d2569ba715
Update stock-not-in-stock.js
10 months ago
dgtlmoon ccb42bcb12 Fetching pages - Custom browser endpoints should not have default proxy info added
11 months ago
dgtlmoon 4163030805 Puppeteer - fixing wait times
11 months ago
dgtlmoon 140d375ad0 Puppeteer - more improvements to proxy and authentication
11 months ago
dgtlmoon 1a608d0ae6
Puppeteer - client fixes for proxy and caching (#2181)
11 months ago
dgtlmoon 008272cd77
Puppeteer fetch - fixing exception names
11 months ago
dgtlmoon 823a0c99f4
Code - Split content fetcher code up (playwright, puppeteer and requests), fix puppeteer direct chrome support (#2169)
11 months ago
dgtlmoon 3287283065
Plawright content fetcher - Fixes for status codes and screenshot info (#2168)
11 months ago
dgtlmoon c5a4e0aaa3
Fetching - Prefer to use SockPuppetBrowser (#2163)
11 months ago
dgtlmoon 5119efe4fb 0.45.14
11 months ago
dgtlmoon 78a2dceb81
Bug fix - fix missing default var (#2162/ #2118/ #2122 )
11 months ago
dgtlmoon e09eb47fb7
Restock detection - Update stock-not-in-stock.js (NL)
11 months ago
dgtlmoon 616c0b3f65
New text filter - Sort text alphabetically filter (#2153)
11 months ago
dgtlmoon c90b27823a
Filtering - include_filters in group and watch settings should not duplicate (#2151 #1845)
11 months ago
dgtlmoon 3b16b19a94
Record notification count and show in [stats] tab (#2150)
11 months ago
Antonio Neri 4ee9fa79e1
Restock - Update stock-not-in-stock.js Italian translation (#2149)
11 months ago
dgtlmoon 4b49759113 UI - Show error/warning when trying to compare the same version
11 months ago
dgtlmoon e9a9790cb0
Fetching - Make an obvious error when using BrowserSteps with the simple text fetcher (#2145)
11 months ago
dgtlmoon 593660e2f6 Fix for switching to price-data-follower mode (when page has JSON price data), only needs to be queued once. Re #1565
11 months ago
dgtlmoon 7d96b4ba83
Fetching - Always record `server` software reply headers (will be used in the future) (#2143)
11 months ago
dgtlmoon fca40e4d5b
Testing - General test workflow improvements (#2144)
11 months ago
dgtlmoon 66e2dfcead
RSS - Include link to the watched URL in the feed (#2139 #2131 and #327)
11 months ago
dgtlmoon bce7eb68fb
Notifications - skip empty notification URLs from being processed (#2138)
11 months ago
dgtlmoon 93c0385119 UI - Filters & Triggers - Adding example for keyword matching in a line
11 months ago
dgtlmoon e17f3be739 RSS - Adding performance stats
11 months ago
dgtlmoon 3a9f79b756 Notification - logging - adding performance information for processing time of notifications #327
11 months ago
dgtlmoon 1f5670253e
UI - Adding icon to show which watch has Browser Steps enabled (#2137)
11 months ago
dgtlmoon fe3cf5ffd2
Logging - Adding extra debug logging to change detection (#2136)
11 months ago
dgtlmoon d31a45d49a
Fetcher - Improve status_code logging (#2130 #2122)
11 months ago
Conner 19ee65361d
Notifications - Bugfix: Notification format not being set correct (HTML emails being sent as plaintext and other problems) (#2129)
11 months ago
dgtlmoon 677082723c
Restock tweaks - use a single regex, tidy up height detection (#2125)
11 months ago
dgtlmoon 96793890f8 Notification - Templates - Adding an example of how to use URL encoding with tokens
11 months ago
dgtlmoon 0439155127 Notification - Templates - Adding an example of how to use |tojson for JSON payloads
11 months ago
dgtlmoon b30b718373 0.45.13
11 months ago
dgtlmoon 402f1e47e7 Security update - Adding API token secure check for API endpoint `/api/v1/watch/<uuid>/history` @rozpuszczalny
11 months ago
dgtlmoon 9510345e01
Test - tidy up backup test (#2117)
11 months ago
dgtlmoon 399cdf0fbf
Logging loguru output tweaks (#2112)
11 months ago
Constantin Hong 4be0fafa93
Support Loguru as a logger (#2036)
11 months ago
dgtlmoon 51ce7ac66e
Update stock-not-in-stock.js texts
11 months ago
dgtlmoon c3d825f38c
Test - Adding extra test for HTML output in emails ( #2103 )
12 months ago
dgtlmoon 1749c07750
Restock detection - Check all elements for text to get stock status from, only consider elements inside the viewport, only consider elements more than 100px from the top (avoid menu) , trim any text returned (#2040)
12 months ago
dgtlmoon 65428655b8
Notifications - When any in a list of notifications fails, the others should still work (#2106)
12 months ago
dgtlmoon 8be0029260
Browser Steps - Fixing "'Response' object is not subscriptable" where quotes were used in connection URL - Quote wrapped URL for browserstep url was breaking the connection #1627 #1823 #2099 (#2100)
12 months ago
kiyell 3c727ca54b
Added OPTIONS HTTP method (#2094)
12 months ago
dgtlmoon 4596532090 API Docs - Examples should use port 5000 (same as the docker-compose default installation and other documentation)
12 months ago
dgtlmoon d0a88d54a1 0.45.12
12 months ago
dgtlmoon 21ab4b16a0 0.45.11
12 months ago
dgtlmoon 77133de1cf
Notification fixes - error on mailto:// when no format was specified, fixing default body and title of notifications to respect global settings (#2085)
12 months ago
dgtlmoon 764514e5eb 0.45.10
12 months ago
dgtlmoon e051b29bf2
Browser Steps - General error handling improvements (#2083)
12 months ago
Christian Arnold 126852b778
Browser Steps - Fix for correct tokens/information in browser step failure notification (#2066)
12 months ago
dgtlmoon d115b2c858
UI - [Send test notification] - Refactor to use all tokens like a real watch and Notification Body+Title from UI value (#2079)
12 months ago
dgtlmoon 946a556fb6
Restock detection - "In stock" should be None/"Not yet checked" by default (#2069)
12 months ago
dgtlmoon eda23678aa Restock detection - updating texts
12 months ago
dgtlmoon 273bd45ad7
Fetching - Custom browser on experimental/puppeteer fetcher - Don't switch to custom puppeteer mode if external browser URL is active (#2068)
12 months ago
dgtlmoon 3d1e1025d2 0.45.9
1 year ago
dgtlmoon 5528b7c4b3 Restock detection - Update stock-not-in-stock.js strings (Dutch translations)
1 year ago
dextouu 792fedb8bc
Restock detection - Update stock-not-in-stock.js strings (#2032)
1 year ago
dgtlmoon 824748df9e API - Updating documentation
1 year ago
dgtlmoon 8e207ba438
API - Ability to add/import bulk list of watches as a line-feed separated list (#2021)
1 year ago
dgtlmoon f0823126c8
Notifications - Fixing support for headers in custom post://, posts:// notifications, ability to include HTTP headers when making custom notifications (#2018)
1 year ago
dgtlmoon 98f56736c1
Improve handling of SIGTERM shutdown in containers, remove unnecessary multi-process handler for pip installs, tidy up modules (#2014)
1 year ago
dgtlmoon 872bd2de85 UI - Extra Browsers - Adding links and more resources on how to connect a fingerprint/scraping browser
1 year ago
dgtlmoon e6de1dd135 0.45.8.1
1 year ago
dgtlmoon 599291645d
PDF Fetcher for change detection - Always use plain requests for PDF because otherwise we cant access the embed PDF in the browser (#2020)
1 year ago
dgtlmoon 156d403552 UI - Fix - Edit Watch 'Show advanced options' should fire at page load to show you whats possible
1 year ago
dgtlmoon 7fe0ef7099 0.45.8
1 year ago
dgtlmoon fe70beeaed Restock detector - adding more detection strings
1 year ago
dgtlmoon abf7ed9085 UI - remove incorrect label
1 year ago
dgtlmoon 19e752e9ba UI - "Add new watch" URL at main input box should always grow to match the viewport
1 year ago
dgtlmoon 684e96f5f1
UI - Tidy-up for advanced settings under watch edit, HTML validation fixes (#2011)
1 year ago
dgtlmoon 8f321139fd UI - 'Request body' section disappears after switching from 'Playwright' to 'System settings default' and back on 'Request' tab - Fixed #1449
1 year ago
dgtlmoon 7fdae82e46 Browser Steps - Adding validation for "Click X,Y" step
1 year ago
dgtlmoon bbc18d8e80
API - Make sure the watch "is viewed" attribute is correctly represented in the API output (#2009)
1 year ago
dgtlmoon d8ee5472f1
Update playwright fetcher library and API calls
1 year ago
dgtlmoon 8fd57280b7
Testing - Improve PDF text change detection tests (#1992)
1 year ago
dgtlmoon 0285d00f13
UI - Clicking the "[Diff]" link should take you to the difference starting at the relative time to when you last viewed the difference page (#1989)
1 year ago
dgtlmoon f7f98945a2
Visual Selector - xPath handling misc fixes (#1976)
1 year ago
dgtlmoon 5e2049c538 Fix build issue
1 year ago
Constantin Hong 26931e0167
feature: Support XPath2.0 to 3.1 (#1774)
1 year ago
dgtlmoon 5229094e44
New functionanlity - Selectable browser / ability to add extra browser connections (good for using "scraping browsers"/ etc) (#1943)
1 year ago
dgtlmoon 5a306aa78c
API/UI - Button to regenerate API key (#1975 / #1967)
1 year ago
dgtlmoon c8dcc072c8
Code refactor for fetchers (#1941)
1 year ago
dgtlmoon 7c97a5a403 0.45.7.3
1 year ago
dgtlmoon 3607d15185 0.45.7.2
1 year ago
dgtlmoon 3382b4cb3f
UI - Cleanup fonts better display in firefox, request CSS according to version (#1968)
1 year ago
dgtlmoon 06975d6d8f 0.45.7.1
1 year ago
dgtlmoon 80f8d23309 0.45.7
1 year ago
dgtlmoon 9f41d15908 UI - Fixing issue where search box JS interfered with page render when logged out
1 year ago
dgtlmoon 89797dfe02 0.45.6
1 year ago
dgtlmoon c905652780
UI - Adding support-us widget <3 (#1956)
1 year ago
dgtlmoon 99246d3e6d
Visual Selector - Small fix, Improving elements fetcher reliability (#1947)
1 year ago
Jai Gupta d3c8386874
Import - Improved Wachete Excel XLS import support for "dynamic wachet" (sets correct state of using chrome browser or not) column (#1934)
1 year ago
dgtlmoon 47103d7f3d
Refactor Excel / wachete import, extend tests (#1931)
1 year ago
dgtlmoon 03c671bfff
Build - Upgrading pip packages (#1915)
1 year ago
dgtlmoon e209d9fba0
Ability to Import from Wachete XLSX (or any XLSX) - Wachete alternative made easy (#1921)
1 year ago
dgtlmoon a0665e1f18 Fetcher - experimental puppeteer fetch - dont rewrite the proxy protocol (fixes socks5 bug)
1 year ago
dgtlmoon 9ffe7e0eaf Nice format stats (comma sep)
1 year ago
dgtlmoon cd1aca9ee3 0.45.5
1 year ago
dgtlmoon 6a589e14f3
BrowserSteps - Wrong text taken from browser steps (#1911)
1 year ago
dgtlmoon dbb76f3618 0.45.4
1 year ago
dgtlmoon 4ae27af511
Code cleanup - Browser Steps
1 year ago
dgtlmoon e1860549dc
Fetching - Browser Step enabled watches should also identify 404/non-200 status situations (#1907)
1 year ago
dgtlmoon 9765d56a23
Text Filters - "Extract Text" filter was not being error checked properly when using a RegEx (#1902)
1 year ago
dgtlmoon 349111eb35
Fetching/BrowserSteps - Going to a page was using slightly logic to the main way - make them use the same methods (#1890)
1 year ago
dgtlmoon 71e50569a0 UI - "With errors" tag/button should always show the current tag error count
1 year ago
Marcelo Alencar 0aef5483d9
Upgrade selenium to 4.14.0 (latest) (#1783)
1 year ago
dgtlmoon c266c64b94
UI - Don't show search icon when logged out (#1896)
1 year ago
dgtlmoon 32e5498a9d
UI - Adding handy "limit to watches with errors" button (#1886)
1 year ago
dgtlmoon 0ba7928d58 UI - Viewing text differences - Tweaks to "Jump to next change" button
1 year ago
dgtlmoon 1709e8f936
UI - BrowserSteps - Show the screenshot of an error if it happened on a step, highlight which step had the error to make it easier to find out why the step didnt work, minor fixes to timeouts(#1883)
1 year ago
dgtlmoon b16d65741c UI - Visual Selector should be the same page-size as Browser Steps (fit inside the browser viewport)
1 year ago
dgtlmoon b58d521d19
UI - Adding [stats] tab to watch Edit page (#1880)
1 year ago
dgtlmoon 52225f2ad8
Bugfix - [Clear history] button was not clearing all metadata (#1881)
1 year ago
dgtlmoon 7220afab0a
RSS fetch - RSS field <title> was not rendering as text correctly, added workaround #1879
1 year ago
dgtlmoon 1c0fe4c23e
PDF Fetching - Handle when the PDF is given as inline content without a proper mime header (#1875)
1 year ago
dgtlmoon f707c914b6
RSS Fetching - Handle CDATA (commented out text) in RSS correctly, generally handle RSS better (#1866)
1 year ago
dgtlmoon 9cb636e638 UI - Adding mouseover/title to show absolute date/time of a last-change or last-checked date #1860
1 year ago
dgtlmoon 1d5fe51157 UI - Difference text viewer - fixing jump to new difference on changing word/line/etc style
1 year ago
dgtlmoon c0b49d3be9 Testing - Improve xPath tests (#1863)
1 year ago
dgtlmoon c4dc85525f UI - Fixing jump to next difference button after refactor
1 year ago
dgtlmoon 26159840c8 UI - Updating proxy tip link
1 year ago
dgtlmoon 522e9786c6
UI - Adding watch label/title to [edit] page title (#1858)
1 year ago
dgtlmoon f9f6300a70 UI - Difference page - added 'title' to each change for nice mouse-over information about when the change occured
1 year ago
dgtlmoon 7734b22a19 UI - Difference page - Tweak 'preview' page invite text
1 year ago
dgtlmoon da421fe110
UI - Ability to select between any difference date ( from / to ) and minor UI cleanup for differences page (#1855)
1 year ago
dgtlmoon 3e2b55a46f UI - Difference page, make the button to find the preview page for triggers and ignored text easier to find
1 year ago
dgtlmoon 7ace259d70
System - No need to run updates on fresh installs (#1854)
1 year ago
dgtlmoon aa6ad7bf47 UI - Proxy configuration helper notes improvements
1 year ago
dgtlmoon 40dd29dbc6
Preview/Difference page - When sharing the preview/difference page, highlight-to-ignore should login should be required (#1852)
1 year ago
dgtlmoon 7debccca73
Fetching - Clarifying how fetchers work with SOCKS5 proxies
1 year ago
dgtlmoon 59578803bf 0.45.3
1 year ago
dgtlmoon ceac8c21e4
LD JSON Price followers - Handle incorrectly created LD-JSON price structures better (#1837)
1 year ago
dgtlmoon 2b948c15c1
Backend - Regular expression / string filtering refactor for Python 3.11 and deprecation warnings since Python 3.6 (#1786)
1 year ago
dgtlmoon 700729a332 UI - BrowserSteps - Browser Steps interface screen should resize relative to the browser
1 year ago
dgtlmoon b6060ac90c BrowserSteps - <input> of type 'number' should use 'enter text in field'
1 year ago
dgtlmoon 5cccccb0b6 Restock detect - bumping texts for restock detection
1 year ago
dgtlmoon c52eb512e8 UI - Proxy Scanner tool should also understand when a filter is empty or contains only an image
1 year ago
dgtlmoon 7282df9c08 UI + Fetching - Improving helper message when filter contains only an image (adding link to more help)
1 year ago
dgtlmoon e30b17b8bc
UI + Fetching - Be more helpful when a filter contains no text, suggest ways to deal with images in filters (#1819)
1 year ago
dgtlmoon 57de4ffe4f
Page fetching - Fixed possible incorrect browser user-agent header in playwright/puppeteer/browserless fetchers (#1811)
1 year ago
dgtlmoon 51e2e8a226
UI - Add extra validation help for notification body with Jinja2 markup (#1810)
1 year ago
dgtlmoon 8887459462 UI - More precise text to describe "current_snapshot" notification token
1 year ago
dgtlmoon 460c724e51 0.45.2
1 year ago
dgtlmoon dcf4bf37ed
Code/Test - Improve testing for creating backups
1 year ago
dgtlmoon e3cf22fc27 UI - Re-order notification field settings
1 year ago
dgtlmoon d497db639e UI - Notifications - Tidyup - Hide the notification tokens but show with a button/link
1 year ago
dgtlmoon 7355ac8d21 UI - Notifications - Tweak discord help text
1 year ago
dgtlmoon 2f2d0ea0f2 RSS feeds - Fixing broken links from RSS index in some environments, refactor code (#152, #148, #1684, #1798)
1 year ago
dgtlmoon a958e1fe20
UI - "recheck all" button should ignore blank/empty "tag" setting when set
1 year ago
dgtlmoon 8ac4757cd9 UI - Fix spelling error
1 year ago
dgtlmoon 2180bb256d UI - Make tgram:// and discord:// examples in notification settings link to how-to pages (#1785)
1 year ago
dgtlmoon 212f15ad5f
Catch possible crash scenario for listing watches - `date_created` was missing on add (#1787)
1 year ago
dgtlmoon 22b2068208
Ability to select "No proxy" for a watch when you have proxy's configured
1 year ago
dgtlmoon 0aa2276afb UI - Fixing update for sort by "date created" or "#" in watch overview table ( #1775 )
1 year ago
Tiago Ilieve 3b875e5a6a
Add 'diff_patch' notification body token - This will allow the diff to be generated in the "unified patch format." (#1765)
1 year ago
dgtlmoon e3c9255d9e 0.45.1
1 year ago
dgtlmoon 3b03bdcb82 UI - Fixing open/broken HTML which was causing some buttons to not display
1 year ago
dgtlmoon e25792bcec 0.45
1 year ago
dgtlmoon bf4168a2aa
Adding Oxylabs proxy recommendation to proxy config page (#1756)
1 year ago
dgtlmoon 9d37eaa57b
Fix - Link in the RSS feed was showing the path twice (when used in reverse proxy)
1 year ago
dgtlmoon 40d01acde9 Fix - Regular Expression text in `ignore` and `trigger` were not processing correctly, also refactored for lower CPU usage (#1747)
1 year ago
dgtlmoon ed4bafae63 UI - "Test notification" button in "Group Tag" settings page was broken due to missing variable #1753
1 year ago
dgtlmoon 3a5bceadfa UI - Clicking 'ignore text' when highlighting text should clear the preview text button/area. #1754
1 year ago
dgtlmoon dee23709a9 0.44.2
1 year ago
dgtlmoon 52df3b10e7
UI - Ability to highlight text and have it offered as a ignore-text option, really nice easy way to set ignores on changing text (#1746)
1 year ago
dgtlmoon a3d8bd0b1a Updating in app links
1 year ago
dgtlmoon 6ef8a1c18f
Updating URL validation library, ability to block access to simple (no dot) hostnames like "localhost" with BLOCK_SIMPLEHOSTS setting (#1732)
1 year ago
dgtlmoon cfa712c88c 0.44.1
1 year ago
dgtlmoon e7f726c057 UI - Fixing darkmode switch icon
1 year ago
dgtlmoon df0cc7b585 0.44
1 year ago
dgtlmoon f84ba0fb31 API - Updating API description for handling a single watch
1 year ago
dgtlmoon 661f7fe32c
Proxy scan improvements - handle custom proxies, dont restart when a scan is already running (#1689)
1 year ago
dgtlmoon 7cb7eebbc5 Browser Steps - When cleaning up old screenshots, check the file exists
1 year ago
dgtlmoon aaceb4ebad Scan/Recheck proxies - Report filter not found as "OK" but with warning
1 year ago
dgtlmoon 56cf6e5ea5
Bug fix - Previously encountered fetch errors were sometimes not being cleared (#1687)
1 year ago
dgtlmoon 1987e109e8
New feature - Helper button to trigger a scan/access test of all proxies for a particular watch (#1685)
1 year ago
dgtlmoon 20d65cdd26 0.43.2
2 years ago
dgtlmoon 37ff5f6d37
Bug - SMTP mailto:// Notification content-type (HTML/Text) fix and add CI tests (#1660)
2 years ago
dgtlmoon 2f777ea3bb
Fix - Watches werent falling back to global default formats correctly when required (#1656)
2 years ago
dgtlmoon e709201955 0.43.1
2 years ago
dgtlmoon 572f71299f
Bug fix - Notification settings were not cascading from global -> tags -> watch correctly in some cases (#1654)
2 years ago
dgtlmoon 5f150c4f03
Bug - Fix watch clone (#1647)
2 years ago
dgtlmoon 8cbf8e8f57
UI - Dont allow empty tag names (#1641)
2 years ago
dgtlmoon 0e65dda5b6 0.43
2 years ago
dgtlmoon 72a415144b UI - Watch Table - Clicking anywhere on the watch list row table also activates the operations buttons and checkbox
2 years ago
dgtlmoon 52f2c00308
UI/Functionality - Ability to manage/apply filters and notifications across tags/groups
2 years ago
Raymond Ha 72311fb845
UI - Fixes to dark mode toggle (#1629)
2 years ago
dgtlmoon a4c620c308
Code - Adding CI test for search (#1626)
2 years ago
dgtlmoon 9434eac72d 0.42.3
2 years ago
dgtlmoon edb5e20de6
Bug fix - Fixed crash when deleting watch from UI when watch was already manually deleted from datadir (#1623)
2 years ago