Skip to content

Releases: webrecorder/browsertrix-crawler

Browsertrix Crawler v1.6.3

16 Jun 20:00
d2a6aa9
Compare
Choose a tag to compare

What's Changed

  • content-type compare for rewriting: use case-insensitive check by @ikreymer in #849
  • Disable disk utilization check by default by @tw4l in #850
  • cleanup: remove dead pywb code from argparser and docs by @rien333 in #847
  • version: bump to 1.6.3 by @ikreymer in #851

New Contributors

Full Changelog: v1.6.2...v1.6.3

Browsertrix Crawler v1.6.2

03 Jun 20:36
a5936b5
Compare
Choose a tag to compare

What's Changed

  • lang code fixes: by @ikreymer in #834
  • Add WARC-Protocol header by @ikreymer in #715
  • tmpdir: use os.tmpdir() instead of hardcoded '/tmp' by @ikreymer in #842
  • Remove hardcoded /tmp prefix from path by @tw4l in #843
  • optimization: normalize dedup status: treat 0 (response code not yet known) or 206 as 200… by @ikreymer in #835
  • remove early serialization which may result in missing WARC-Protocol and security metadata by @ikreymer in #844
  • deps: bump brave 1.79.118 by @ikreymer in #845

Full Changelog: v1.6.1...v1.6.2

Browsertrix Crawler v1.6.1

05 May 17:57
e39d5a3
Compare
Choose a tag to compare

What's Changed

Full Changelog: v1.6.0...v1.6.1

Browsertrix Crawler v1.6.0

10 Apr 08:21
1cb1b2e
Compare
Choose a tag to compare

What's Changed

  • Support for behaviors from 'recorder flow' JSON created in devtools by @ikreymer in #818
  • regression fix: start redis if needed before attempting to init state! by @ikreymer in #819
  • Update Behaviors Docs by @ikreymer in #820

Full Changelog: v1.5.11...v1.6.0

Browsertrix Crawler v1.6.0-beta.1

09 Apr 19:40
f2dac05
Compare
Choose a tag to compare
Pre-release

What's Changed

  • regression fix: start redis if needed before attempting to init state! by @ikreymer in #819

Full Changelog: v1.6.0-beta.0...v1.6.0-beta.1

Browsertrix Crawler v1.6.0-beta.0

09 Apr 10:25
c796996
Compare
Choose a tag to compare
Pre-release

What's Changed

  • Support for behaviors from 'recorder flow' JSON created in devtools by @ikreymer in #818

Full Changelog: v1.5.11...v1.6.0-beta.0

Browsertrix Crawler v1.5.11

04 Apr 15:24
2961d3b
Compare
Choose a tag to compare

What's Changed

  • ci: add workflow to deploy to dev channels (requires actions secrets config) by @ikreymer in #815
  • Write behaviors downloaded from URL to tempdir by @tw4l in #816

Full Changelog: v1.5.10...v1.5.11

Browsertrix Crawler v1.5.10

04 Apr 00:41
66c71d0
Compare
Choose a tag to compare

What's Changed

  • Remove extra console.log statements by @ikreymer in #811
  • useSHA1 Parameter for generating SHA1 record hashes (#532) by @aponb in #812
  • Add option to push behavior + behavior script logs to Redis by @tw4l in #805
  • browser crash handling, follow-up to #808: by @ikreymer in #813
  • deps: bump base browser image to 1.77.95 by @ikreymer in #814

New Contributors

Full Changelog: v1.5.9...v1.5.10

Browsertrix Crawler v1.5.9

02 Apr 05:12
91f8fad
Compare
Choose a tag to compare

What's Changed

  • docs: Update header font by @Shrinks99 in #785
  • deps: update to warcio.js 2.4.4, fixes #796 by @ikreymer in #802
  • Validate Autoclick selector, fail crawl if invalid by @tw4l in #800
  • Add clarification in usage about hostname used by @benoit74 in #771
  • Move extractLinks to behaviors + Update to browsertrix-behaviors 0.8.0 by @ikreymer in #803
  • Fail crawl with fatal message if custom behavior isn't loaded by @tw4l in #799
  • Better default crawlId by @ikreymer in #806
  • stuck page handling: when attempting to restart browser, add more retries by @ikreymer in #808
  • Tweaks for custom behavior loading by @tw4l in #807
  • Update screencast reported aspect ratio by @emma-sg in #794
  • saved state tweaks: by @ikreymer in #809
  • deps update: update webrecorder dependencies by @ikreymer in #810

Full Changelog: v1.5.8...v1.5.9

Browsertrix Crawler v1.5.8

01 Mar 02:01
9a7ac9b
Compare
Choose a tag to compare

What's Changed

  • Fix using cached WACZ filename if already set ahead of time. by @ikreymer in #783

Full Changelog: v1.5.7...v1.5.8