Commit Graph

59 Commits (8253074d5677614f12655f2c8cdc419a3958e88d)

Author SHA1 Message Date
dgtlmoon fba719ab8d Ability for watch to use a more obvious system default fetcher (#1320)
2 years ago
dgtlmoon de15dfd80d
Reliability fix - Remove loop that could cause app to stop checking if data changes (#1313)
2 years ago
dgtlmoon 13c4121f52
PDF File change detection - Initial PDF fetcher support with basic text extraction (#1244)
2 years ago
dgtlmoon b7a2501d64
Fetching - Always sort the key order of JSON content for less false alerts (May cause an alert on upgrade, but will be better going forwards) #1219
2 years ago
dgtlmoon b76148a0f4
Fetcher - CPU usage - Skip processing if the previous checksum and the just fetched one was the same (#925)
2 years ago
dgtlmoon 14da0646a7
Price follower - Dont scan for ldjson data when 'no' was clicked on the suggestion (#1207)
2 years ago
dgtlmoon b58fd995b5 Automatically offer to track LD+JSON product price data (#1204)
2 years ago
dgtlmoon 5b530ff61c
Configurable "Browser Steps" when Playwright/Chrome is configured (enter text, scroll, wait for text, click button etc) (#478)
2 years ago
dgtlmoon b043d477dc
Use deepcopy to stop possible data corruption (#1108)
2 years ago
dgtlmoon 06bcfb28e5 Code- Use dict .get instead of key
2 years ago
dgtlmoon 359fc48fb4
Filters can now accept a list/multiple filters (#1064) #623
2 years ago
dgtlmoon 77b59809ca
Removing unused code (#1070)
2 years ago
dgtlmoon 7f6a13ea6c
Re #1052 - Watch 'open' link should use any dynamic/template info (#1063)
2 years ago
dgtlmoon 724cb17224
Re #1052 - Dynamic URLs, use variables in the URL (such as the current date, the date in a month, and other logic see https://github.com/dgtlmoon/changedetection.io/wiki/Handling-variables-in-the-watched-URL ) (#1057)
2 years ago
Yusef Ouda dfa7fc3a81
Adds support for jq JSON path querying engine (#1001)
2 years ago
dgtlmoon d4715e2bc8
Tidy up proxies.json logic, adding tests (#955)
2 years ago
dgtlmoon 0e194aa4b4 Default proxy settings fixes
2 years ago
dgtlmoon 2ba55bb477
Use proxies.json instead of proxies.txt - see wiki Proxies section (#945)
2 years ago
dgtlmoon 6168cd2899
Code maintenance - Removing old function (#875)
2 years ago
dgtlmoon d67c654f37
Be sure visual-selector data is set when xPath/CSS filter is not yet found (#851)
2 years ago
dgtlmoon 9942107016
Massive improvements to error handling - show separate output for non HTTP 200 status replies
2 years ago
dgtlmoon faa42d75e0 Refactor of extract text filter - Regex, support Regex (groups) and all python regex flags via /something/aiLmsux (#773)
2 years ago
dgtlmoon dd0eeca056 Handle simple obfuscations - HomeDepot.com style price obfuscation (#764)
2 years ago
Freddie Leeman 0bde48b282
Regex extract filter: Return all regex results instead of first match (#730)
2 years ago
dgtlmoon fae1164c0b
Ability to specify JS before running change-detection (#744)
2 years ago
dgtlmoon 2b054ced8c
[new filter] Filter option - Trigger only when NEW content (lines) are detected ( compared to earlier text snapshots ) (#685)
2 years ago
dgtlmoon 83555a9991
bug fix: `last_changed` was being set on the first fetch, should only be set on the change after the first fetch #705
2 years ago
dgtlmoon 7da32f9ac3 New filter - Block change-detection if text matches - for example, block change-detection while the text "out of stock" is on the page, know when the text is no longer on the page (#698)
2 years ago
dgtlmoon 76996b9eb8 Some changes werent getting triggered because the previous checksum only recorded when an event occured
2 years ago
dgtlmoon 4101ae00c6
New feature - "Extract text" filter ability (#624)
2 years ago
dgtlmoon aa3c8a9370
Move history data to a textfile, improves memory handling (#638)
2 years ago
dgtlmoon eef56e52c6 Adding new Visual Selector for choosing the area of the webpage to monitor - playwright/browserless only (#566)
2 years ago
dgtlmoon 6734fb91a2
Option to control if pages with no renderable content are a change (example: JS webapps that dont render any text sometimes) (#608)
2 years ago
dgtlmoon 67c833d2bc
Re #214 - configurable wait extra seconds for webdriver requests before extracting text (#606)
2 years ago
dgtlmoon f28c260576
Distill.io JSON export file importer (#592)
3 years ago
dgtlmoon 18f0b63b7d
Ability to specify a list of proxies to choose from, always using the first one by default, See wiki (#591)
3 years ago
dgtlmoon 68db20168e
Add new fetch method: Playwright Chromium (Selenium/WebDriver alternative) (#489)
3 years ago
dgtlmoon 9e708810d1
Seconds/minutes/hours/days between checks form field upgrade from 'minutes' only (#512)
3 years ago
dgtlmoon 380c512cc2
Adding support for change detection of HTML source-code via "source:https://website.com" prefix (#540)
3 years ago
dgtlmoon 34a87c0f41
HTTP Fetcher code improvements
3 years ago
dgtlmoon 9809af142d
Option to render links as [Some Text ](/link), adds the ability to change-detect on hyperlink changes
3 years ago
dgtlmoon 9fe4f95990
When fetching a snapshot via Chrome, make the most recent screenshot available on the Diff and Preview pages (#516)
3 years ago
dgtlmoon 942c3f021f
Allow changedetector to ignore status codes as a per-site setting (#479) (#485)
3 years ago
dgtlmoon f2fa638480
Security update - Protect against file:/// type access by webdriver/chrome. (#483)
3 years ago
Tim Loderhose d4359c2e67
Add filter to remove elements by CSS rule from HTML before change detection is run (#445)
3 years ago
dgtlmoon 96664ffb10
Better text/plain detection and refactor tests (#443)
3 years ago
dgtlmoon 014fda9058
Ability to visualise trigger and filter rules against the current snapshot on the preview page
3 years ago
dgtlmoon a0e4f9b88a better checking of JSON type
3 years ago
dgtlmoon 22ef9afb93
Refactor tests for notification error log handler (#404)
3 years ago
dgtlmoon 39b7be9e7a
plaintext mime type fix - Don't attempt to extract HTML content from plaintext, this will remove lines and break changedetection (#391)
3 years ago