Skip to content

Releases: replicate/pget

v0.8.1

28 Apr 22:32
v0.8.1
6193d8a
Compare
Choose a tag to compare

Changelog

v0.8.0

27 Apr 20:30
v0.8.0
Compare
Choose a tag to compare

The big changes

  • Reduced memory usage, we aggressively reuse buffers to minimize the problems with OOM due to buffering.
    • note that memory usage still scales with chunk size and concurrency
  • Tar extraction now supports most major compression types (automatically): gzip, xz, lz4, lzw, bzip2
  • It is recommended that weights are not compressed, as the penalty to decompress ca be as high as 50x slower. This is to remove a sharp edge on pget
  • Security fixes (zipslip)
  • Order of files downloaded is guaranteed to be in order of the manifest (interesting things, but not super relevant for most use cases)
  • Golang 1.22
  • pidfile now uses XDG_RUNTIME_DIR which improves usability for non-root usage.
  • General tar fixes
    • Skip headers where needed instead of erroring
    • More output with --verbose logging
    • Tar's target path is now autocreated instead of needing to be pre-created
  • Using null consumer (download but don't actually save the bytes to disk) can be invoked without a destination path
    • pget -o null instead of needing pget -o null
  • Lots of other general cleanup internally

Changelog

  • 52f0b36 Address comments
  • 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
  • 49a3330 Bump github.com/golangci/golangci-lint from 1.56.2 to 1.57.2
  • b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
  • c142e5c Bump golang.org/x/sync from 0.6.0 to 0.7.0
  • cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
  • d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
  • a5dbcc3 Bump golang.org/x/tools from 0.19.0 to 0.20.0
  • 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
  • 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
  • 49be4e3 Create path when using file writer
  • 0a38633 Fix single arg null consumer
  • 4fcac8d Fix tar-extract
  • 247d885 Guarantee Order of Downloads in multifile mode
  • 40e0dd7 Handle Overwriting in the Consumer
  • ee32098 Implement Stream Decompression for tar
  • 368e526 Improve Stream Decompression
  • df2a2f6 Improve consistent-hash testing with httpmock (#157)
  • afcbff4 Improve null consumer
  • 87835a6 Improve pidfile location for non-root
  • 9154d43 Make .gitignore better
  • db7cc43 Move Enabling Overwrite to .GetConsumer()
  • 8473ce8 Prevent ZipSlip
  • 4916726 Rearrange concurrency control and error handling (#191)
  • b6d4d5a Reuse buffers used by bufferedReader (#177)
  • 14a5144 Skip global PAXHeaders
  • 42ce722 Update manifest.go
  • 2f5d638 Use Golang 1.22
  • 58cccd0 fixed chunk size (#173)
  • c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
  • 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)

v0.8.0-alpha2

21 Mar 23:35
v0.8.0-alpha2
d84009f
Compare
Choose a tag to compare
v0.8.0-alpha2 Pre-release
Pre-release

Changelog

  • d84009f Add STDOut Consumer
  • 52f0b36 Address comments
  • 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
  • b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
  • cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
  • d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
  • 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
  • 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
  • 49be4e3 Create path when using file writer
  • 0a38633 Fix single arg null consumer
  • 4fcac8d Fix tar-extract
  • 247d885 Guarantee Order of Downloads in multifile mode
  • 40e0dd7 Handle Overwriting in the Consumer
  • df2a2f6 Improve consistent-hash testing with httpmock (#157)
  • afcbff4 Improve null consumer
  • 87835a6 Improve pidfile location for non-root
  • db7cc43 Move Enabling Overwrite to .GetConsumer()
  • 8473ce8 Prevent ZipSlip
  • 4916726 Rearrange concurrency control and error handling (#191)
  • b6d4d5a Reuse buffers used by bufferedReader (#177)
  • 42ce722 Update manifest.go
  • 2f5d638 Use Golang 1.22
  • 58cccd0 fixed chunk size (#173)
  • c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
  • 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)

v0.8.0-alpha1

21 Mar 18:48
v0.8.0-alpha1
af9e62f
Compare
Choose a tag to compare
v0.8.0-alpha1 Pre-release
Pre-release

Changelog

  • af9e62f Add STDOut Consumer
  • 52f0b36 Address comments
  • 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
  • b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
  • cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
  • d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
  • 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
  • 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
  • 49be4e3 Create path when using file writer
  • 0a38633 Fix single arg null consumer
  • 4fcac8d Fix tar-extract
  • 247d885 Guarantee Order of Downloads in multifile mode
  • 40e0dd7 Handle Overwriting in the Consumer
  • df2a2f6 Improve consistent-hash testing with httpmock (#157)
  • afcbff4 Improve null consumer
  • 87835a6 Improve pidfile location for non-root
  • db7cc43 Move Enabling Overwrite to .GetConsumer()
  • 8473ce8 Prevent ZipSlip
  • 4916726 Rearrange concurrency control and error handling (#191)
  • b6d4d5a Reuse buffers used by bufferedReader (#177)
  • 42ce722 Update manifest.go
  • 2f5d638 Use Golang 1.22
  • 58cccd0 fixed chunk size (#173)
  • c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
  • 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)

v0.6.2

13 Feb 18:27
v0.6.2
Compare
Choose a tag to compare

Changelog

  • 4517037 Bump github.com/golangci/golangci-lint from 1.55.2 to 1.56.1 (#153)
  • 7593122 Gracefully handle missing SRV records

v0.6.1

07 Feb 17:45
v0.6.1
12cf853
Compare
Choose a tag to compare

Changelog

  • f9cb74c Bump github.com/rs/zerolog from 1.31.0 to 1.32.0 (#149)
  • 12cf853 Fix Consistent-Hash Memory Leak (#151)

v0.6.0

19 Jan 22:41
v0.6.0
4ad9d1e
Compare
Choose a tag to compare

Changelog

  • 84f6155 Add example manifest file
  • 6ff69a1 Bump github.com/spf13/viper from 1.18.1 to 1.18.2
  • 6b86987 Bump golang.org/x/tools from 0.16.1 to 0.17.0
  • 63220e6 Fix goreleaser asset name template (#139)
  • 1ee201d Fix test for default cache uri
  • 3cecf9f Implement consistent-hash domains configurable (#127)
  • ef7f831 Restore default cacheable URL prefix
  • e111459 Unhide --pid-file option
  • ae0f960 add contributing guide (#140)
  • 769ff5e clarify that this is a different pget
  • 4ad9d1e document how to install binaries from GitHub (#141)
  • 1cc6e6d fix homebrew install command (#138)
  • eea2076 slice boundary bug (#146)

v0.6.0-beta1

26 Dec 21:36
v0.6.0-beta1
1849f48
Compare
Choose a tag to compare
v0.6.0-beta1 Pre-release
Pre-release

Changelog

  • 6ff69a1 Bump github.com/spf13/viper from 1.18.1 to 1.18.2
  • 1849f48 Complete implementation for configurable cache uri prefixes
  • 38f2977 Implement consistent-hash domains configurable

v0.5.7-beta2

19 Dec 23:36
v0.5.7-beta2
06725cf
Compare
Choose a tag to compare
v0.5.7-beta2 Pre-release
Pre-release

Changelog

  • 06725cf Try implement UPX compression

v0.5.7-beta1

19 Dec 22:59
v0.5.7-beta1
51cc7d6
Compare
Choose a tag to compare
v0.5.7-beta1 Pre-release
Pre-release

Changelog

  • 51cc7d6 Try implement UPX compression