Releases: webrecorder/browsertrix-crawler
Releases · webrecorder/browsertrix-crawler
Browsertrix Crawler v1.6.3
What's Changed
- content-type compare for rewriting: use case-insensitive check by @ikreymer in #849
- Disable disk utilization check by default by @tw4l in #850
- cleanup: remove dead pywb code from argparser and docs by @rien333 in #847
- version: bump to 1.6.3 by @ikreymer in #851
New Contributors
Full Changelog: v1.6.2...v1.6.3
Browsertrix Crawler v1.6.2
What's Changed
- lang code fixes: by @ikreymer in #834
- Add WARC-Protocol header by @ikreymer in #715
- tmpdir: use os.tmpdir() instead of hardcoded '/tmp' by @ikreymer in #842
- Remove hardcoded /tmp prefix from path by @tw4l in #843
- optimization: normalize dedup status: treat 0 (response code not yet known) or 206 as 200… by @ikreymer in #835
- remove early serialization which may result in missing WARC-Protocol and security metadata by @ikreymer in #844
- deps: bump brave 1.79.118 by @ikreymer in #845
Full Changelog: v1.6.1...v1.6.2
Browsertrix Crawler v1.6.1
What's Changed
- state: add trimqueue() redis command to trim queue / seen list by @ikreymer in #821
- Config Policy Update by @ikreymer in #822
- Deps update 1.6.1 by @ikreymer in #826
- more dependency updates: by @ikreymer in #827
- support pause interrupt: by @ikreymer in #825
Full Changelog: v1.6.0...v1.6.1
Browsertrix Crawler v1.6.0
Browsertrix Crawler v1.6.0-beta.1
What's Changed
Full Changelog: v1.6.0-beta.0...v1.6.0-beta.1
Browsertrix Crawler v1.6.0-beta.0
What's Changed
Full Changelog: v1.5.11...v1.6.0-beta.0
Browsertrix Crawler v1.5.11
What's Changed
- ci: add workflow to deploy to dev channels (requires actions secrets config) by @ikreymer in #815
- Write behaviors downloaded from URL to tempdir by @tw4l in #816
Full Changelog: v1.5.10...v1.5.11
Browsertrix Crawler v1.5.10
What's Changed
- Remove extra console.log statements by @ikreymer in #811
- useSHA1 Parameter for generating SHA1 record hashes (#532) by @aponb in #812
- Add option to push behavior + behavior script logs to Redis by @tw4l in #805
- browser crash handling, follow-up to #808: by @ikreymer in #813
- deps: bump base browser image to 1.77.95 by @ikreymer in #814
New Contributors
Full Changelog: v1.5.9...v1.5.10
Browsertrix Crawler v1.5.9
What's Changed
- docs: Update header font by @Shrinks99 in #785
- deps: update to warcio.js 2.4.4, fixes #796 by @ikreymer in #802
- Validate Autoclick selector, fail crawl if invalid by @tw4l in #800
- Add clarification in usage about hostname used by @benoit74 in #771
- Move extractLinks to behaviors + Update to browsertrix-behaviors 0.8.0 by @ikreymer in #803
- Fail crawl with fatal message if custom behavior isn't loaded by @tw4l in #799
- Better default crawlId by @ikreymer in #806
- stuck page handling: when attempting to restart browser, add more retries by @ikreymer in #808
- Tweaks for custom behavior loading by @tw4l in #807
- Update screencast reported aspect ratio by @emma-sg in #794
- saved state tweaks: by @ikreymer in #809
- deps update: update webrecorder dependencies by @ikreymer in #810
Full Changelog: v1.5.8...v1.5.9
Browsertrix Crawler v1.5.8
What's Changed
Full Changelog: v1.5.7...v1.5.8