Releases: s3gw-tech/s3gw
v0.23.0
Release Notes - v0.23.0
This release contains significant improvements and new bug fixes. Notably,
this release brings more SQLite efficiency, better consistency when we use
's3gw' vs 'rgw' terminology, and several UI improvements.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related with known issues, one
should feel encouraged to file an issue in our
Github repository.
Features
- rgw/sfs: Add SQLite connection pool
- rgw/sfs: Begin transition from sqlite_orm to sqlite_modern_cpp
- rgw/sfs: Rename on-disk database from s3gw.db to sfs.db
- rgw/sfs: Standardize log levels
- ui: Subpath support for better Longhorn integration
- ui: Allow deletion of specific objects
- ui: Support configuring S3 addressing style
- ui: Identify instance associated with the running UI
Fixes
- rgw/sfs: Improve attribute setting
- rgw/sfs: Init bucket mtime
- rgw/sfs: Delete multiparts only on existing buckets
- rgw/sfs: Mark all OPEN versions DELETED on startup
- rgw/sfs: Ignore deleted buckets when listing multiparts
- rgw/sfs: Remove dangling multipart build files in case of error
- ui: Prevent user from logging out when deleting a locked object version
- ui: Fix error when deleting an object in an unversioned bucket
- ui: Fix buggy prefix handling in REST API
- ui: Fix object deletion behavior when objects share the same base pattern
Breaking Changes
One major user-facing behavior has changed for those relying on the vanilla
container images. If you rely on the Helm Chart you should not be affected.
- The
s3gw
container's entrypoint is now a wrapper script,entrypoint.sh
,
abstracting some options and functionality. Options provided when running the
container image must now conform to the new script, although previous options
can still be passed directly to the underlyingrgw
after--
. For more
information, please check the documentation at Advanced Usage.
Known Issues
- No known issues.
What's Changed
Full Changelog: aquarist-labs/s3gw-tools@v0.22.0...v0.23.0
v0.22.0
Release Notes - v0.22.0
This release contains significant improvements and new bug fixes. Notably,
this release brings improved multipart and sqlite stability.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related with known issues, one
should feel encouraged to file an issue in our
Github repository.
Features
- rgw/sfs: Improved SQLite WAL usage
- rgw/sfs: Improved disk usage when copying objects
- rgw/sfs: Improved testing
- ui: Various improvements
Fixes
- rgw/sfs: Allow multiple delete markers
- rgw/sfs: Fix various multipart transactions
- rgw/sfs: Check number of file descriptors on start
- rgw/sfs: Updated bucket stats
- ui: unable to access UI due to admin ops verifying cert
- ui: The Show/Hide button must have at least one default value
- ui: Dropdown buttons are not rendered correct
- ui: Disable caching of index.html
Breaking Changes
Known Issues
v0.21.0
Release Notes - v0.21.0
This release contains significant improvements and new bug fixes. Notably,
this release brings server-side encryption support, conditional copy object,
improvement in profiling.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related with known issues, one
should feel encouraged to file an issue in our
Github repository.
Features
- rgw/sfs: Add server-side encryption support
- rgw/sfs: Conditional copy object
- ui : Make use of the UI REST API to prevent CORS issues
Fixes
- rgw/sfs: Improve sqlite connection handling
- rgw/sfs: Fix missing multipart etag
- rgw/sfs: Fix etag and mtime not being sent with copy object response
- rgw/sfs: Increase build error reporting
- rgw/sfs: Improve profiling (sqlite, garbage collection)
- ui: Prevent switching bucket retention mode from Compliance to Governance
Breaking Changes
Known Issues
v0.20.0
Release Notes - v0.20.0
This release contains significant improvements and new bug fixes, particularly
in the s3gw backing store. Notably, this release brings garbage collection,
improved bucket listing, including filtering, and conditional GETs.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related with known issues, one
should feel encouraged to file an issue in our
Github repository.
Features
- rgw/sfs: Query-based version listing
- rgw/sfs: Support conditional GETs
- rgw/sfs: New garbage collection implementation
- rgw/sfs: Change on-disk file format, add suffixes
- ui backend: Parity with operations required by UI
Fixes
- rgw/sfs: Fix warnings after enabling more compilation flags
- rgw/sfs: Several code cleanup efforts
- rgw/sfs: use global part id for multipart parts
Breaking Changes
- On-disk format for both metadata and data store have changed.
Known Issues
- There are no known issues.
v0.19.0
Release Notes - v0.19.0
This release contains various fixes and improvements in the backend. Most
notably, error handling, multipart handling and internal bookkeeping of objects
has improved.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related to the list below, one
should feel encouraged to file an issue in our
GitHub repository.
Features
- rgw/sfs: Log SQLite error / warning messages
- rgw/sfs: Add SQLite retries and error handling
- rgw/sfs: Improve multipart handling
- ui backend: Add endpoints for user management
- ui backend: Add bucket management endpoints
- ui frontend: Allow creating admin users
Fixes
- rgw/sfs: Fix Invalid argument exception on exit with telemetry off
- rgw/sfs: Fix delete bucket when not empty
- rgw/sfs: Abort on-going multiparts on bucket removal
- rgw/sfs: Fix bucket listing
- rgw/sfs: Various fixes to object state transitions
- ui frontend: Fix table header on zoom-in
- ui frontend: Fix bucket deletion dialogue in
Administrator
mode - ui frontend: Fix creating keys for users
Breaking Changes
- On-disk format for the metadata store changed
Known Issues
v0.18.0
Release Notes - v0.18.0
This release contains numerous fixes for the UI and a refactoring of the object
versioning implementation.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related to the list below, one
should feel encouraged to file an issue in our
GitHub repository.
Features
- UI: Add a hint to the prefix field in the lifecycle rule dialog (#600)
- UI: Enhance branding support (#572)
- SFS: Implement new versioning design (#378, #472, #547, #526, #524, #519)
Fixes
- UI: Deleting a versioned object is not properly implemented (#550)
- UI: Do not delete object by version (#576)
- UI: Prevent the restoring of the deleted object version (#583)
- UI: Creating an enabled lifecycle rule is not working (#587)
- UI: Disable download button for deleted objects (#595)
- UI: Do not close data table column menu on inside clicks (#599)
- Chart: Update logo and source URLs (#570)
- Chart: Validate email for tls issuer (#596)
- Chart: Fix installation failure when publicDomain is empty (#602)
Breaking Changes
- On-disk format for the metadata store changed
Known Issues
v0.17.0
Release Notes - v0.17.0
This release contains a number of changes to the internal data structures and
metadata schema in preparation for a more streamlined versioning and multipart
implementation. In addition to that, the UI received a number of bug fixes,
quality of life improvements and a stylistic overhaul, including the logo and
colorscheme. The UI also received a large number of end-to-end tests as well as
an update to the Angular version.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related to the list below, one
should feel encouraged to file an issue in our
GitHub repository.
Features
- UI: Branding Support (#552)
- UI: Upgrade to Angular 15 (#513)
- UI: Adapt logo and style (#530)
- UI: Various improvements
Fixes
- UI: Fix incorrect pagination when using search/filters (#559)
- UI: Fix search function only searching a single page (#556)
- UI: Fix redundant 'clear' buttons for search (#554)
- UI: Fix objects with delete markers being displayed (#548)
- Chart: Fix "unsupported protocol" bug for the COSI driver (#511)
Breaking Changes
- On-disk format for the metadata store changed
Known Issues
What's Changed
- ci: migrate github output by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/307
- Change
ghcr.io/aquarist-labs
toquay.io/s3gw
. by @votdev in https://github.com/aquarist-labs/s3gw/pull/310 - Update documentation for default-user S3 credentials by @giubacc in https://github.com/aquarist-labs/s3gw/pull/309
- ci: add nightly build by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/308
- ci: fix nightly build syntax by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/315
- ci: nightly - remove references to set-git-refs by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/316
- ci: nightly builds log into quay.io by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/317
- ci: use correct quay.io repo by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/318
- ci: nightly pipeline build-env outputs the tag by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/319
- docs: add release notes for v0.2.0 and v0.4.0 by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/320
- ci: release pipeline, drop libradosgw by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/323
- s3gw: release notes for v0.11.0 by @jecluis in https://github.com/aquarist-labs/s3gw/pull/328
- docs: remove Release from Release Captain's ADR, and create a new document by @jecluis in https://github.com/aquarist-labs/s3gw/pull/321
- remove tools submodule by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/330
- Wip/tools merge by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/331
- docs: Update quickstart guide by @s0nea in https://github.com/aquarist-labs/s3gw/pull/329
- Add last ADRs to menu in docs by @jhmarina in https://github.com/aquarist-labs/s3gw/pull/332
- fix: remove faulty submodule by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/333
- fix build_radosgw CCACHE environment variable by @irq0 in https://github.com/aquarist-labs/s3gw/pull/334
- ci: remove libradosgw from nightly builds by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/335
- ci: build-environment triggers and fixes by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/336
- ci: fix build-environment trigger by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/337
- ci: fix build environment container tags by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/338
- Fix (relative) path to s3gw-ui Git repository. by @votdev in https://github.com/aquarist-labs/s3gw/pull/342
- fix Dockerfile.build-radosgw-test-container by @giubacc in https://github.com/aquarist-labs/s3gw/pull/343
- ci: fix stupid input to GH action by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/339
- ci: build environment using buildx by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/344
- ci: fix naming of dockerfiles and workflow matrix by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/345
- ci: rebuild build environments weekly by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/346
- ci: fix s3-test runner script by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/340
- Release v0.12.0 by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/347
- ci: on-disk format checker and release tests by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/348
- ci: fix s3test runner script by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/353
- ci: s3tests runner log from container by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/356
- ci: fix missing 'uses' in releaes workflow by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/369
- ci: fix quay login by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/370
- ci: fix namespace for enviroment variable by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/371
- ci: use github.ref_name by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/372
- ci: fix typo in container name by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/373
- ci: install s3cmd in release workflow by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/375
- adr: Pull Request and Code Review Guide by @irq0 in https://github.com/aquarist-labs/s3gw/pull/360
- ci: fix on disk format checker on container crash by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/379
- ci: fix ondisk-format checker job by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/383
- ci: fix path of helpers script by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/384
- ci: fix prerelease tests by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/386
- Release v0.13.0 by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/387
- release 0.13.0 by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/391
- ci: unify container build by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/392
- ci: fix typo in release workflow by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/405
- ci: explicitly set up docker context by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/408
- The Traefik ingress is misconfigured, Access-Control-Expose-Headers must be set to '*' by @votdev in https://github.com/aquarist-labs/s3gw/pull/412
- Add 0.14.0 Release Notes by @irq0 in https://github.com/aquarist-labs/s3gw/pull/413
- docs: fixes in the release process by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/411
- Spell Check docs/* by @irq0 in https://github.com/aquarist-labs/s3gw/pull/415
- ci: cURL latest release form GH API by @irq0 in https://github.com/aquarist-labs/s3gw/pull/416
- ci: fix s3test-runner for host environment by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/414
- tools: Remove RGW_DEFAULT_USER_SYSTEM from code by @votdev in https://github.com/aquarist-labs/s3gw/pull/429
- ci/s3tests: add extra parameter added for lifecycle s3tests by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/430
- Add minikube instant demo script by @irq0 in https://github.com/aquarist-labs/s3gw/pull/418
- docs/design: s3gw-ui backend design document by @jecluis in https://github.com/aquarist-labs/s3gw/pull/403
- docs: fix spelling in ui backend design doc by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/435
- ci: nightly pipeline add expiry date by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/425
- doc: Reviewing and editing documentation by @asettle in https://github.com/aquarist-labs/s3gw/pull/440
- Update theme nav & add material theme by @jhmarina in https://github.com/aquarist-labs/s3gw/pull/442
- Update .github/workflows/release.yaml by @giubacc in https://github.com/aquarist-labs/s3gw/pull/446
- fix Dockerfile not capturing all the sfs unittests by @giubacc in https://github.com/aquarist-labs/s3gw/pull/450
- ci: add s3gw unittests to be executed by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/452
- ci: run s3tests in parallel by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/434
- ci: fix GNU parallel in s3tests runner by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/468
- ci: Fix environment for GNU parallel by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/469
- Docs: updated requirements.txt by @jhmarina in https://github.com/aquarist-labs/s3gw/pull/476
- ci/s3tests-runner.sh : export CONTAINER_EXTRA_PARAMS by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/475
- ci: make s3tests parallel execution optional by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/478
- Docs: Remove regex from requirements by @jhmarina in https://github.com/aquarist-labs/s3gw/pull/477
- add COSI submodules and conform CI to COSI by @giubacc in https://github.com/aquarist-labs/s3gw/pull/441
- fix COSI dockerfile location in CI by @giubacc in https://github.com/aquarist-labs/s3gw/pull/482
- ci: release pipeline, fix on-disk format check by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/417
- Add s3gw-v0.15.0.md and update submodules to v0.15.0 by @giubacc in https://github.com/aquarist-labs/s3gw/pull/485
- ci: fix ondisk format checker by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/486
- amend v0.15.0 release notes by @giubacc in https://github.com/aquarist-labs/s3gw/pull/487
- bump charts submodule to v0.15.0 by @giubacc in https://github.com/aquarist-labs/s3gw/pull/488
- ci: fix nightly workflow's docker and test by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/489
- Release Tool by @irq0 in https://github.com/aqu...
v0.16.0
Release Notes - v0.16.0
This release cycle focused on architecture adjustments to the s3gw service's
backend store (SFS), which will be reflected on upcoming releases.
Most noteworthy outcome of this release is the initial COSI support for s3gw.
This can be enabled via the Helm Chart.
We have also disabled user and bucket quotas via the UI. Quotas are currently
not supported by the s3gw service, and have been kept in the UI to demonstrate
what we believe to be the right approach to them. As the backend development
progresses, quotas will be re-enabled when the right time comes.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related to the list below, one
should feel encouraged to file an issue in our
GitHub repository.
Features
- Kubernetes: Add experimental COSI support.
- UI: Add new experimental python backend for the UI.
- UI: Disable bucket and user quotas in the UI.
Fixes
- None
Breaking Changes
- None
Known Issues
- SFS: Non-versioned GETs may observe dirty data of concurrent non-multipart
PUTs.
v0.15.0
Release Notes - v0.15.0
This release focuses on stabilizing our continuous integration and release process.
In this context, we have also addressed a number of issues that was affecting our
testing framework when automatically triggered by CI.
Although this activity may not result in any direct user-facing improvements,
it plays a crucial role in maintaining a stable environment for the upcoming major
enhancements that the s3gw team is currently developing.
We continue to address the regular issues that affect all of s3gw's components.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related to the list below, one
should feel encouraged to file an issue in our
GitHub repository.
Features
- SFS: Improve error handling and robustness of non-multipart PUT operations.
- SFS: Telemetry: the backend now periodically exchanges data with our upgrade responder.
- UI: Add tags support for objects.
Fixes
- CI: Various fixes focused on the stabilization and the consistency of the process.
- Tests: Various fixes related with the integration with both the CI and the
release process.
Breaking Changes
- None
Known Issues
- SFS: Non-versioned GETs may observe dirty data of concurrent non-multipart PUTs.
What's Changed
- tools: Remove RGW_DEFAULT_USER_SYSTEM from code by @votdev in https://github.com/aquarist-labs/s3gw/pull/429
- ci/s3tests: add extra parameter added for lifecycle s3tests by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/430
- Add minikube instant demo script by @irq0 in https://github.com/aquarist-labs/s3gw/pull/418
- docs/design: s3gw-ui backend design document by @jecluis in https://github.com/aquarist-labs/s3gw/pull/403
- docs: fix spelling in ui backend design doc by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/435
- ci: nightly pipeline add expiry date by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/425
- doc: Reviewing and editing documentation by @asettle in https://github.com/aquarist-labs/s3gw/pull/440
- Update theme nav & add material theme by @jhmarina in https://github.com/aquarist-labs/s3gw/pull/442
- Update .github/workflows/release.yaml by @giubacc in https://github.com/aquarist-labs/s3gw/pull/446
- fix Dockerfile not capturing all the sfs unittests by @giubacc in https://github.com/aquarist-labs/s3gw/pull/450
- ci: add s3gw unittests to be executed by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/452
- ci: run s3tests in parallel by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/434
- ci: fix GNU parallel in s3tests runner by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/468
- ci: Fix environment for GNU parallel by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/469
- Docs: updated requirements.txt by @jhmarina in https://github.com/aquarist-labs/s3gw/pull/476
- ci/s3tests-runner.sh : export CONTAINER_EXTRA_PARAMS by @0xavi0 in https://github.com/aquarist-labs/s3gw/pull/475
- ci: make s3tests parallel execution optional by @m-ildefons in https://github.com/aquarist-labs/s3gw/pull/478
- Docs: Remove regex from requirements by @jhmarina in https://github.com/aquarist-labs/s3gw/pull/477
New Contributors
- @asettle made their first contribution in https://github.com/aquarist-labs/s3gw/pull/440
Full Changelog: aquarist-labs/s3gw-tools@v0.14.0...v0.15.0
v0.14.0
Release Notes - v0.14.0
This release adds lifecycle management, object locks (legal holds) and an
updated version of the radosgw we use for the backend.
This release is meant for testing and feedback gathering. It is not recommended
for production use.
Should a bug be found and not expected to be related to the list below, one
should feel encouraged to file an issue in our
GitHub repository.
Features
- SFS: Initial lifecycle management support
- SFS: Object Lock - Legal holds
- SFS: Metadata database: Add indices to often queried columns
- SFS: Simplify write state machine. Remove writing object state.
Writes no longer need to update the object state during IO. - SFS: Update radosgw to Ceph Upstream 0e2e7d594b8
- UI: Display object data more intuitively
- UI: Enhance user key management page
- UI: Add button to copy the current path of the object browser to the clipboard
- UI: Lifecycle management
Fixes
Breaking Changes
- On-disk format for the metadata store changed
Known Issues
No known issues