aboutsummaryrefslogtreecommitdiff
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
...
* Move ListObjects tests to RustQuentin Dufour2022-03-072-0/+433
|
* More permissive OPTIONS on S3 APIv0.6.1better-corsAlex Auvolat2022-03-013-20/+50
|
* Add tracing output to signature calculationAlex Auvolat2022-02-281-0/+3
|
* Process CORS earlier in pipelineAlex Auvolat2022-02-284-7/+39
|
* Support for PostObject (#222)trinity-1686a2022-02-2110-69/+642
| | | | | | | | | | | | | | | | | | Add support for [PostObject](https://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectPOST.html) - [x] routing PostObject properly - [x] parsing multipart body - [x] validating signature - [x] validating policy - [x] validating content length - [x] actually saving data Co-authored-by: trinity-1686a <trinity@deuxfleurs.fr> Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/222 Reviewed-by: Alex <alex@adnab.me> Co-authored-by: trinity-1686a <trinity.pointard@gmail.com> Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
* garage(tests): Remove RNG stuffJill2022-02-113-16/+1
|
* garage(tests): Remove superfluous testJill2022-02-101-30/+0
|
* garage(tests): Add random suffix to created buckets.Jill2022-02-104-9/+31
|
* garage(tests): Add some unsafe-usage doc and tweaksJill2022-02-101-5/+8
|
* Add integration tests to DroneQuentin Dufour2022-02-101-1/+7
|
* tests: Fix garage integration testJill2022-02-102-7/+3
|
* tests: Add garage integration tests (base)Jill2022-02-109-0/+428
|
* Fix a bug when a migration is followed by a rebalanceAlex Auvolat2022-02-101-9/+18
| | | | | | | Nodes would stabilize on different encoding formats for the values, some having the pre-migration format and some having the post-migration format. This would be reflected in the Merkle trees never converging and thus having an infinite resync loop.
* Hide deleted key in bucket info (fix #211)Alex Auvolat2022-02-021-0/+3
|
* Add restriction on part ordering in CompleteMultipartUploadv0.6.0-rc1get-head-part-numberAlex Auvolat2022-01-251-0/+11
|
* Fix partnumberAlex Auvolat2022-01-251-91/+117
|
* Implement part_number for GetObjectAlex Auvolat2022-01-241-73/+146
|
* Multipart improvementsAlex Auvolat2022-01-245-34/+129
| | | | | - support part_number for HeadObject - add checks in complete_multipart_upload
* Handle OPTIONS on website endpointbucket-corsAlex Auvolat2022-01-244-36/+13
|
* Implement {Put,Get,Delete}BucketCors and CORS in generalAlex Auvolat2022-01-2410-73/+572
| | | | | | - OPTIONS request against API endpoint - Returning corresponding CORS headers on API calls - Returning corresponding CORS headers on website GET's
* use clamp instead of min(max())Trinity Pointard2022-01-241-4/+3
|
* Implement ListPartsQuentin Dufour2022-01-212-4/+389
|
* Add ListPartsResult structureQuentin Dufour2022-01-201-6/+121
|
* Add date verification to presigned urls (#196)trinity-1686a2022-01-186-35/+67
| | | | | | | | | | fix #96 fix #162 by returning Forbidden instead Bad Request Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/196 Co-authored-by: trinity-1686a <trinity.pointard@gmail.com> Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
* refactor s3_router and api_server to make unused Endpoint parameters more ↵trinity-1686a2022-01-172-239/+129
| | | | obvious
* Fix Multipart Upload with WinSCP (#164) (#193)Jill2022-01-171-2/+7
| | | | | | | | Closes #164. Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/193 Co-authored-by: Jill <kokakiwi@deuxfleurs.fr> Co-committed-by: Jill <kokakiwi@deuxfleurs.fr>
* Support STREAMING-AWS4-HMAC-SHA256-PAYLOAD (#64) (#156)Jill2022-01-179-75/+484
| | | | | | | | Closes #64. Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/156 Co-authored-by: Jill <kokakiwi@deuxfleurs.fr> Co-committed-by: Jill <kokakiwi@deuxfleurs.fr>
* Make use of website config, return error document on errorAlex Auvolat2022-01-133-29/+103
|
* Allow setting index document and error document on the CLIAlex Auvolat2022-01-132-2/+10
|
* Implement GetBucketWebsiteAlex Auvolat2022-01-132-19/+55
|
* Add quotes in returned etagsimprove-copiesAlex Auvolat2022-01-134-53/+45
|
* Testing for UploadPartCopies and bugfixes in AWS signaturesAlex Auvolat2022-01-132-3/+7
|
* Implement UploadPartCopyAlex Auvolat2022-01-135-54/+413
|
* Implement x-amz-copy-if-xxx copy preconditions and return more headers on ↵Alex Auvolat2022-01-132-0/+107
| | | | copy (fix #187)
* Implement ListMultipartUploads (#171)Quentin2022-01-128-257/+1100
| | | | | | | | | | | | | | | | | | | | | | | Implement ListMultipartUploads, also refactor ListObjects and ListObjectsV2. It took me some times as I wanted to propose the following things: - Using an iterator instead of the loop+goto pattern. I find it easier to read and it should enable some optimizations. For example, when consuming keys of a common prefix, we do many [redundant checks](https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/main/src/api/s3_list.rs#L125-L156) while the only thing to do is to [check if the following key is still part of the common prefix](https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/feature/s3-multipart-compat/src/api/s3_list.rs#L476). - Try to name things (see ExtractionResult and RangeBegin enums) and to separate concerns (see ListQuery and Accumulator) - An IO closure to make unit tests possibles. - Unit tests, to track regressions and document how to interact with the code - Integration tests with `s3api`. In the future, I would like to move them in Rust with the aws rust SDK. Merging of the logic of ListMultipartUploads and ListObjects was not a goal but a consequence of the previous modifications. Some points that we might want to discuss: - ListObjectsV1, when using pagination and delimiters, has a weird behavior (it lists multiple times the same prefix) with `aws s3api` due to the fact that it can not use our optimization to skip the whole prefix. It is independant from my refactor and can be tested with the commented `s3api` tests in `test-smoke.sh`. It probably has the same weird behavior on the official AWS S3 implementation. - Considering ListMultipartUploads, I had to "abuse" upload id marker to support prefix skipping. I send an `upload-id-marker` with the hardcoded value `include` to emulate your "including" token. - Some ways to test ListMultipartUploads with existing software (my tests are limited to s3api for now). Co-authored-by: Quentin Dufour <quentin@deuxfleurs.fr> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/171 Co-authored-by: Quentin <quentin@dufour.io> Co-committed-by: Quentin <quentin@dufour.io>
* Clarify error messageAlex Auvolat2022-01-102-9/+10
|
* Fix trivial bug in CLIAlex Auvolat2022-01-101-2/+6
|
* Fix unit testsAlex Auvolat2022-01-052-12/+44
|
* Fix some error codesAlex Auvolat2022-01-058-36/+53
|
* Small CLI changesAlex Auvolat2022-01-051-5/+8
|
* Implement DeleteBucketAlex Auvolat2022-01-053-6/+116
|
* Implement CreateBucketAlex Auvolat2022-01-055-28/+166
|
* Implement key allow|deny --create-bucketAlex Auvolat2022-01-052-0/+48
|
* Small changes in key model and refactoringnew-bucketsAlex Auvolat2022-01-047-103/+119
|
* New buckets for 0.6.0: make bucket id a SK and not a HK, CLI updatesAlex Auvolat2022-01-049-47/+86
|
* New buckets for 0.6.0: small changesAlex Auvolat2022-01-0412-62/+86
| | | | | | | | | | | | - Fix bucket delete - fix merge of bucket creation date - Replace deletable with option in aliases Rationale: if two aliases point to conflicting bucket, resolving by making an arbitrary choice risks making data accessible when it shouldn't be. We'd rather resolve to deleting the alias until someone puts it back.
* Rename and change query filtersAlex Auvolat2022-01-043-8/+8
|
* Refactor logic for setting/unsetting aliasesAlex Auvolat2022-01-045-413/+570
|
* Remove website redirectsAlex Auvolat2022-01-044-20/+14
|
* Some movement of helper code and refactoring of error handlingAlex Auvolat2022-01-0416-66/+136
|