Commit Graph

85 Commits (66e2dfcead0b5b427af01dce5a33213410b6dba6)

Author SHA1 Message Date
dgtlmoon 82b900fbf4 Give more helpful error message when a page doesnt load
2 years ago
dgtlmoon 358a365303 Tweaks to playwright fetch code - better timeout handling
2 years ago
dgtlmoon 8294519f43 Content fetcher - Handle when a page doesnt load properly
2 years ago
dgtlmoon 8ba8a220b6 Playwright - Correctly close browser context/sessions on exceptions
2 years ago
dgtlmoon 5cefb16e52 Minor code cleanup
2 years ago
dgtlmoon 341ae24b73 Re #616 - content trigger - adding extra test (#620)
2 years ago
dgtlmoon 9d742446ab Playwright - ByPass CSP for more reliable JS scraping, disable accept downloads
2 years ago
dgtlmoon e3e022b0f4 VisualSelector - Better handling of filter targets that are no longer available in the HTML
2 years ago
dgtlmoon 7983675325 Visual Selector - be more resilient when sites interfere with the xPath scraping
2 years ago
dgtlmoon eef56e52c6 Adding new Visual Selector for choosing the area of the webpage to monitor - playwright/browserless only (#566)
2 years ago
dgtlmoon 6734fb91a2
Option to control if pages with no renderable content are a change (example: JS webapps that dont render any text sometimes) (#608)
3 years ago
dgtlmoon 16809b48f8 Playwright - raise EmptyReply on empty reply, no need to process further
3 years ago
dgtlmoon 67c833d2bc
Re #214 - configurable wait extra seconds for webdriver requests before extracting text (#606)
3 years ago
weeix 31fea55ee4
Fix PLAYWRIGHT_DRIVER_URL default value (cf. #587) (#599)
3 years ago
dgtlmoon 18f0b63b7d
Ability to specify a list of proxies to choose from, always using the first one by default, See wiki (#591)
3 years ago
dgtlmoon 9807cf0cda Playwright - code fix
3 years ago
dgtlmoon d4b5237103 Playwright fetcher - more reliable by just waiting arbitrary seconds after the last network IO
3 years ago
dgtlmoon dc6f76ba64
Make proxy configuration more consistent - see https://github.com/dgtlmoon/changedetection.io/wiki/Proxy-configuration (#585)
3 years ago
dgtlmoon 1f2f93184e Playwright fetcher - use the correct default User-Agent
3 years ago
dgtlmoon 68db20168e
Add new fetch method: Playwright Chromium (Selenium/WebDriver alternative) (#489)
3 years ago
dgtlmoon 9fe4f95990
When fetching a snapshot via Chrome, make the most recent screenshot available on the Diff and Preview pages (#516)
3 years ago
dgtlmoon 942c3f021f
Allow changedetector to ignore status codes as a per-site setting (#479) (#485)
3 years ago
dgtlmoon 3e8a15456a
Detect byte-encoding when the server mishandles the content-type header reply (#472)
3 years ago
dgtlmoon 8d2e240a2a When using Env. FETCH_WORKERS or WEBDRIVER_DELAY_BEFORE_CONTENT_READY , it should be type int
3 years ago
dgtlmoon 5214a7e0f3 Adding Env var "WEBDRIVER_DELAY_BEFORE_CONTENT_READY" to wait n seconds before extracting the text from the browser
3 years ago
dgtlmoon f87f7077a6
Better handling of EmptyReply exception, always bump 'last_checked' in the case of an error (#354)
3 years ago
Unpublished 023951a10e
Be sure that documents returned with a application/json header are not parsed with inscriptis (#337)
3 years ago
dgtlmoon 489671dcca
Re #342 notification encoding (#343)
3 years ago
dgtlmoon 735fc2ac8e Adding new proxyType to selenium mappings
3 years ago
Calvin Bui feb8e6c76c
Add socksVersion mapping (#331)
3 years ago
dgtlmoon d602cf4646 Aligning call signatures #325
3 years ago
Simon Caron dfcae4ee64
Extend Request Parameters to add Body & Method (#325)
3 years ago
dgtlmoon 8ec17a4c83
Re #267 - Pass settings for the proxy setup for webdriver (#326)
3 years ago
dgtlmoon 4ed5d4c2e7 WebDriver fetcher - settings - when an alternative one is configured, show it in the label
3 years ago
dgtlmoon a11b6daa2e
Installation via pip (#186)
3 years ago