Commit Graph

39 Commits (minor-stock-scraper)

Author SHA1 Message Date
dgtlmoon 4b1cfd7bd3 Stock/not-in-stock scraper - slight reliability improvement
3 months ago
dgtlmoon 7f2fa20318
Small memory allocation fixes (#2625)
4 months ago
dgtlmoon 60d292107d
Fixing restock monitor tests and tweaking docker default config example,
4 months ago
dgtlmoon 4225900ec3 Restock - updating texts and text offsets
4 months ago
dgtlmoon 7071df061a
Price detection/scraping - Adding extra element training data (#2582)
4 months ago
dgtlmoon 730f37c7ba
Set encoding type for scraper script reader (#2574 #2568)
4 months ago
dgtlmoon 8a35d62e02
Handle zero-byte/empty content responses with "`[ ] Empty pages are a change`" option, the same as when the HTML doesnt render any useful text (#2530)
5 months ago
dgtlmoon 2fd762a783
Encode POST style requests and notifications as UTF-8 if it has no encoding/basic string (#2523)
5 months ago
Kenny Root d7e85ffe8f
VisualSelector+BrowserSteps - When scraping elements, check for null results (#2517)
5 months ago
dgtlmoon e756e0af5e
Fixing file:// file pickup - for change detection of local files (#2505)
5 months ago
dgtlmoon cffb6d748c
Restock & Price monitor - Huge refactor, set upper and lower price alert limits, set % change, follow the prices and restock amounts directly in the watch-overview list
6 months ago
dgtlmoon 732ae1d935
Bugfix - Watches with BrowserSteps should recreate the data-dir if it was missing (in the case that you deleted/migrated) (#2484)
6 months ago
dgtlmoon ed38012c6e
Code - Fixing deprecation warning (#2477)
6 months ago
dgtlmoon f07ff9b55e
UI - Visual Selector should still update when elements were not found (#2476)
6 months ago
dgtlmoon e09ee7da97
UI - Visual Selector - Show/visualise all/any matching filter elements from all filters in "CSS/JSONPath/JQ/XPath Filters" include filters (#2440)
6 months ago
dgtlmoon 5d9081ccb2 Restock detection - Updating detection texts
6 months ago
Max Michels 13e343f9da
Restock detection - Added extra out-of-stock phrases for DE (#2442)
6 months ago
dgtlmoon 13be4623db Restock detection - updating texts
6 months ago
dgtlmoon cc147be76e
Prefer pythons built in "importlib" over pkg_resources+setuptools (#2424)
6 months ago
dgtlmoon c6ee6687b5
Fetching/Requests - Fixing user agent header overrides per-watch of global settings (#2409)
7 months ago
dgtlmoon 59cefe58e7
Fetcher - Using pyppeteerstealth with puppeteer fetcher (#2203)
7 months ago
dgtlmoon f49eb4567f
Ability to set default User-Agent for either fetching types directly in the UI (#2375)
7 months ago
dgtlmoon e4504fee49
Browser Steps - Fixing "goto site" step #2330 #2337 (#2364)
8 months ago
dgtlmoon bd6eda696c
Merge pull request from GHSA-4r7v-whpg-8rx3
8 months ago
dgtlmoon 9449c59fbb
Code - Getting ready for newer python versions - packing our own strtobool (#2291)
9 months ago
dgtlmoon e609a2d048 Updating restock detection texts
10 months ago
dgtlmoon c83485094b Updating restock detection texts
10 months ago
dgtlmoon 6b9a788d75 Puppeteer - remove debug hook
10 months ago
dgtlmoon 14e632bc19
Custom headers fix in Browser Steps and Playwright/Puppeteer fetchers ( #2197 )
10 months ago
dgtlmoon a62043e086
Fetching - restock detecting and visual selector scraper - Fixes scraping of elements that are not visible
10 months ago
dgtlmoon 301a40ca34 Fetching - Puppeteer - Adding more debug/diagnostic information
10 months ago
dgtlmoon 1c099cdba6
Update stock-not-in-stock.js
10 months ago
dgtlmoon aefad0bdf6 Code - Remove whitespaces in visual selector elements config
10 months ago
dgtlmoon d2569ba715
Update stock-not-in-stock.js
10 months ago
dgtlmoon ccb42bcb12 Fetching pages - Custom browser endpoints should not have default proxy info added
11 months ago
dgtlmoon 4163030805 Puppeteer - fixing wait times
11 months ago
dgtlmoon 140d375ad0 Puppeteer - more improvements to proxy and authentication
11 months ago
dgtlmoon 1a608d0ae6
Puppeteer - client fixes for proxy and caching (#2181)
11 months ago
dgtlmoon 823a0c99f4
Code - Split content fetcher code up (playwright, puppeteer and requests), fix puppeteer direct chrome support (#2169)
11 months ago