aboutsummaryrefslogtreecommitdiff
path: root/doc/book/src
Commit message (Collapse)AuthorAgeFilesLines
* Implement ListMultipartUploads (#171)Quentin2022-01-121-0/+2
| | | | | | | | | | | | | | | | | | | | | | | Implement ListMultipartUploads, also refactor ListObjects and ListObjectsV2. It took me some times as I wanted to propose the following things: - Using an iterator instead of the loop+goto pattern. I find it easier to read and it should enable some optimizations. For example, when consuming keys of a common prefix, we do many [redundant checks](https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/main/src/api/s3_list.rs#L125-L156) while the only thing to do is to [check if the following key is still part of the common prefix](https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/feature/s3-multipart-compat/src/api/s3_list.rs#L476). - Try to name things (see ExtractionResult and RangeBegin enums) and to separate concerns (see ListQuery and Accumulator) - An IO closure to make unit tests possibles. - Unit tests, to track regressions and document how to interact with the code - Integration tests with `s3api`. In the future, I would like to move them in Rust with the aws rust SDK. Merging of the logic of ListMultipartUploads and ListObjects was not a goal but a consequence of the previous modifications. Some points that we might want to discuss: - ListObjectsV1, when using pagination and delimiters, has a weird behavior (it lists multiple times the same prefix) with `aws s3api` due to the fact that it can not use our optimization to skip the whole prefix. It is independant from my refactor and can be tested with the commented `s3api` tests in `test-smoke.sh`. It probably has the same weird behavior on the official AWS S3 implementation. - Considering ListMultipartUploads, I had to "abuse" upload id marker to support prefix skipping. I send an `upload-id-marker` with the hardcoded value `include` to emulate your "including" token. - Some ways to test ListMultipartUploads with existing software (my tests are limited to s3api for now). Co-authored-by: Quentin Dufour <quentin@deuxfleurs.fr> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/171 Co-authored-by: Quentin <quentin@dufour.io> Co-committed-by: Quentin <quentin@dufour.io>
* Add documentation to migrate to 0.6update-documentationcreate-delete-bucketsAlex Auvolat2022-01-102-0/+47
|
* Update documentationAlex Auvolat2022-01-072-9/+4
|
* update s3 compatibility list (#177)trinity-1686a2021-12-152-16/+22
| | | | | | | Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/177 Co-authored-by: trinity-1686a <trinity.pointard@gmail.com> Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
* Add compression using zstd (#173)trinity-1686a2021-12-152-0/+28
| | | | | | | | | fix #27 Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/173 Co-authored-by: trinity-1686a <trinity.pointard@gmail.com> Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
* Add a second plotdoc/bench-multi-dcQuentin Dufour2021-12-132-1/+21
|
* Update benchmarkdoc/fixQuentin Dufour2021-12-091-0/+0
|
* Typos and dead linksQuentin Dufour2021-12-084-4/+4
|
* Add a benchmark page with a first benchmarkQuentin Dufour2021-12-083-0/+62
|
* S3 compatibility targetv0.5.0.1Alex Auvolat2021-12-062-0/+106
|
* Reorganize and improve documentationAlex Auvolat2021-12-0611-101/+127
|
* WIP front page garageQuentin Dufour2021-12-067-51/+116
|
* Improve how node roles are assigned in Garagev0.5-beta1Alex Auvolat2021-11-169-63/+172
| | | | | | | | | | | | | | | | | - change the terminology: the network configuration becomes the role table, the configuration of a nodes becomes a node's role - the modification of the role table takes place in two steps: first, changes are staged in a CRDT data structure. Then, once the user is happy with the changes, they can commit them all at once (or revert them). - update documentation - fix tests - implement smarter partition assignation algorithm This patch breaks the format of the network configuration: when migrating, the cluster will be in a state where no roles are assigned. All roles must be re-assigned and commited at once. This migration should not pose an issue.
* update doc and commentsTrinity Pointard2021-11-161-5/+7
|
* add s3_api.root_domain to doc bookTrinity Pointard2021-11-163-0/+10
|
* added link to RFID Garage talk (#155)adrien2021-11-161-2/+4
| | | | | | | Co-authored-by: ADRN <adrien@luxeylab.net> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/155 Co-authored-by: adrien <adrien@luxeylab.net> Co-committed-by: adrien <adrien@luxeylab.net>
* Add rclone mount docQuentin Dufour2021-11-101-0/+38
|
* Improve CLI documentationQuentin Dufour2021-11-101-5/+44
|
* Add skeleton for backups, fuse and code sectionsQuentin Dufour2021-11-105-1/+154
|
* Add documentation for Gitea.Quentin Dufour2021-11-101-3/+49
|
* Documentation for Nix binary cacheQuentin Dufour2021-11-103-38/+115
|
* hugo deploy does not build website, fix docQuentin Dufour2021-11-101-1/+2
|
* Move design draft to separate file; write about GC in internalsv0.4.0Alex Auvolat2021-11-093-157/+257
|
* Add documentation for nginxQuentin Dufour2021-11-083-35/+133
|
* Add documentation about GatewaysQuentin Dufour2021-11-082-0/+32
|
* Doc about exposing your websiteQuentin Dufour2021-11-083-1/+86
|
* Harden Garage's systemd serviceQuentin Dufour2021-11-081-5/+16
|
* Documentation for hugo, jekyll and publiiQuentin Dufour2021-11-083-0/+78
|
* Add documentation for synapse-s3-storage-providerQuentin Dufour2021-11-081-4/+105
|
* fix missing bootstrap_peers in docTrinity Pointard2021-11-051-0/+2
|
* Add Peertube + improve CLI instructionsQuentin Dufour2021-11-032-5/+236
|
* Add doc for NextcloudQuentin Dufour2021-11-039-81/+307
|
* Extract toolchain build from the CIbug/rust-muslQuentin Dufour2021-10-291-1/+12
|
* Modified the 'Funding' sentence to remove 'promise' since we actually got ↵doc/got-actually-fundedADRN2021-10-261-2/+2
| | | | the first instalment
* CLI: default rpc_hostv0.4-rc1Alex Auvolat2021-10-261-21/+65
|
* Add download link on homepageAlex Auvolat2021-10-251-1/+2
|
* Improve CLI, adapt tests, update documentationAlex Auvolat2021-10-256-230/+230
|
* Build Garage with Nixfeature/staticQuentin Dufour2021-10-195-12/+572
|
* Add links and put logos in a flexboxfeature/doc-add-ngi-fundingQuentin2021-09-281-6/+12
|
* Doc: add funding disclaimer for NGI/EU grantmricher2021-09-253-1/+10
| | | | PNG logs optimized, render to be checked by @quentin. Fix #106.
* Documentation fixes (typo and small reorganization)Alex Auvolat2021-05-315-53/+95
|
* Write about S3 client configurationAlex Auvolat2021-05-311-0/+89
|
* Updates to documentationAlex Auvolat2021-05-313-5/+18
|
* Reorganize documentationAlex Auvolat2021-05-3116-597/+669
|
* make most changes suggested during install-partyTrinity Pointard2021-05-294-9/+9
|
* Write documentation on configuration file and other improvementsAlex Auvolat2021-05-2814-263/+516
|
* Add links to git/matrix/drone on top of documentationAlex Auvolat2021-05-031-0/+7
|
* Replace talk links with permalinksAlex Auvolat2021-04-301-2/+2
|
* created doc/talks subfolder and added my talk and the previous one done at ↵talksLUXEY Adrien2021-04-301-1/+3
| | | | the wide team
* Update documentationAlex Auvolat2021-04-275-35/+32
|
generated by cgit v1.2.3 (git 2.25.1) at 2024-11-09 02:48:58 +0000