Releases: replicate/pget
Releases · replicate/pget
v0.8.1
v0.8.0
The big changes
- Reduced memory usage, we aggressively reuse buffers to minimize the problems with OOM due to buffering.
- note that memory usage still scales with chunk size and concurrency
- Tar extraction now supports most major compression types (automatically): gzip, xz, lz4, lzw, bzip2
- It is recommended that weights are not compressed, as the penalty to decompress ca be as high as 50x slower. This is to remove a sharp edge on pget
- Security fixes (zipslip)
- Order of files downloaded is guaranteed to be in order of the manifest (interesting things, but not super relevant for most use cases)
- Golang 1.22
- pidfile now uses
XDG_RUNTIME_DIR
which improves usability for non-root usage. - General tar fixes
- Skip headers where needed instead of erroring
- More output with --verbose logging
- Tar's target path is now autocreated instead of needing to be pre-created
- Using null consumer (download but don't actually save the bytes to disk) can be invoked without a destination path
- pget -o null instead of needing pget -o null
- Lots of other general cleanup internally
Changelog
- 52f0b36 Address comments
- 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
- 49a3330 Bump github.com/golangci/golangci-lint from 1.56.2 to 1.57.2
- b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
- c142e5c Bump golang.org/x/sync from 0.6.0 to 0.7.0
- cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
- d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
- a5dbcc3 Bump golang.org/x/tools from 0.19.0 to 0.20.0
- 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
- 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
- 49be4e3 Create path when using file writer
- 0a38633 Fix single arg null consumer
- 4fcac8d Fix tar-extract
- 247d885 Guarantee Order of Downloads in multifile mode
- 40e0dd7 Handle Overwriting in the Consumer
- ee32098 Implement Stream Decompression for tar
- 368e526 Improve Stream Decompression
- df2a2f6 Improve consistent-hash testing with httpmock (#157)
- afcbff4 Improve null consumer
- 87835a6 Improve pidfile location for non-root
- 9154d43 Make .gitignore better
- db7cc43 Move Enabling Overwrite to .GetConsumer()
- 8473ce8 Prevent ZipSlip
- 4916726 Rearrange concurrency control and error handling (#191)
- b6d4d5a Reuse buffers used by bufferedReader (#177)
- 14a5144 Skip global PAXHeaders
- 42ce722 Update manifest.go
- 2f5d638 Use Golang 1.22
- 58cccd0 fixed chunk size (#173)
- c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
- 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)
v0.8.0-alpha2
Changelog
- d84009f Add STDOut Consumer
- 52f0b36 Address comments
- 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
- b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
- cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
- d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
- 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
- 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
- 49be4e3 Create path when using file writer
- 0a38633 Fix single arg null consumer
- 4fcac8d Fix tar-extract
- 247d885 Guarantee Order of Downloads in multifile mode
- 40e0dd7 Handle Overwriting in the Consumer
- df2a2f6 Improve consistent-hash testing with httpmock (#157)
- afcbff4 Improve null consumer
- 87835a6 Improve pidfile location for non-root
- db7cc43 Move Enabling Overwrite to .GetConsumer()
- 8473ce8 Prevent ZipSlip
- 4916726 Rearrange concurrency control and error handling (#191)
- b6d4d5a Reuse buffers used by bufferedReader (#177)
- 42ce722 Update manifest.go
- 2f5d638 Use Golang 1.22
- 58cccd0 fixed chunk size (#173)
- c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
- 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)
v0.8.0-alpha1
Changelog
- af9e62f Add STDOut Consumer
- 52f0b36 Address comments
- 5f3841e Bump github.com/golangci/golangci-lint from 1.56.1 to 1.56.2
- b3feeae Bump github.com/stretchr/testify from 1.8.4 to 1.9.0
- cef25f9 Bump golang.org/x/tools from 0.17.0 to 0.18.0
- d706d1e Bump golang.org/x/tools from 0.18.0 to 0.19.0
- 881b387 Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
- 8d7cd21 Check Tar Extract enablement in PersistentPreRunE
- 49be4e3 Create path when using file writer
- 0a38633 Fix single arg null consumer
- 4fcac8d Fix tar-extract
- 247d885 Guarantee Order of Downloads in multifile mode
- 40e0dd7 Handle Overwriting in the Consumer
- df2a2f6 Improve consistent-hash testing with httpmock (#157)
- afcbff4 Improve null consumer
- 87835a6 Improve pidfile location for non-root
- db7cc43 Move Enabling Overwrite to .GetConsumer()
- 8473ce8 Prevent ZipSlip
- 4916726 Rearrange concurrency control and error handling (#191)
- b6d4d5a Reuse buffers used by bufferedReader (#177)
- 42ce722 Update manifest.go
- 2f5d638 Use Golang 1.22
- 58cccd0 fixed chunk size (#173)
- c72c384 implement Wait() on Strategy to fetch remaining errors (#179)
- 4ebad73 reimplement bufferedReader on top of bufio.Reader (#180)
v0.6.2
v0.6.1
v0.6.0
Changelog
- 84f6155 Add example manifest file
- 6ff69a1 Bump github.com/spf13/viper from 1.18.1 to 1.18.2
- 6b86987 Bump golang.org/x/tools from 0.16.1 to 0.17.0
- 63220e6 Fix goreleaser asset name template (#139)
- 1ee201d Fix test for default cache uri
- 3cecf9f Implement consistent-hash domains configurable (#127)
- ef7f831 Restore default cacheable URL prefix
- e111459 Unhide --pid-file option
- ae0f960 add contributing guide (#140)
- 769ff5e clarify that this is a different pget
- 4ad9d1e document how to install binaries from GitHub (#141)
- 1cc6e6d fix homebrew install command (#138)
- eea2076 slice boundary bug (#146)
v0.6.0-beta1
v0.5.7-beta2
Changelog
- 06725cf Try implement UPX compression
v0.5.7-beta1
Changelog
- 51cc7d6 Try implement UPX compression