aboutsummaryrefslogtreecommitdiff
path: root/src/util
Commit message (Collapse)AuthorAgeFilesLines
* New version of the algorithm that calculate the layout.Mendes2022-09-212-364/+0
| | | | | | | | It takes as paramters the replication factor and the zone redundancy, computes the largest partition size reachable with these constraints, and among the possible assignation with this partition size, it computes the one that moves the least number of partitions compared to the previous assignation. This computation uses graph algorithms defined in graph_algo.rs
* Corrected the warnings and errors issued by cargo clippyMendes2022-05-011-65/+52
|
* Apply cargo fmtAlex Auvolat2022-05-011-348/+346
|
* Change the way new layout assignations are computed.Alex Auvolat2022-05-012-0/+379
| | | | | | The function now computes an optimal assignation (with respect to partition size) that minimizes the distance to the former assignation, using flow algorithms. This commit was written by Mendes Oulamara <mendes.oulamara@pm.me>
* Add missing opentelemetry featuresAlex Auvolat2022-04-081-1/+1
|
* Update to netapp 0.4.2 (a tiny fix)Alex Auvolat2022-04-071-1/+1
|
* Add feature flag for Kubernetes discoveryAlex Auvolat2022-03-242-6/+0
|
* Make background tranquility a configurable parameterAlex Auvolat2022-03-231-0/+7
|
* Update netapp to v0.4.1update-netappAlex Auvolat2022-03-151-1/+1
|
* Implement exponential backoff for resync retriesfeature/opentelemetrybug/resync-exponential-backoffAlex Auvolat2022-03-141-0/+8
|
* Make admin server optionalAlex Auvolat2022-03-141-2/+3
|
* Add wrapper over sled tree to count items (used for big queues)Alex Auvolat2022-03-142-0/+93
|
* Bump version to 0.7 because of incompatible NetappAlex Auvolat2022-03-141-1/+1
|
* Refactoring: rename config files, make modifications less invasiveAlex Auvolat2022-03-141-3/+3
|
* Add metrics to web endpointAlex Auvolat2022-03-141-1/+8
|
* Add metrics to API endpointAlex Auvolat2022-03-141-7/+22
|
* Refactor how durations are measuredAlex Auvolat2022-03-143-0/+38
|
* Remove ... at end of hex IDsAlex Auvolat2022-03-141-1/+1
|
* Update to Netapp 0.4 which supports distributed tracingAlex Auvolat2022-03-141-1/+2
|
* Add tracing integration with opentelemetryAlex Auvolat2022-03-143-2/+4
|
* Update dependencies and add admin module with metricsmricher2022-03-141-0/+10
| | | | | | | | | | - Global dependencies updated in Cargo.lock - New module created in src/admin to host: - the (future) admin REST API - the metric collection - add configuration block No metrics implemented yet
* add support for kubernetes service discoveryMax Audron2022-03-123-0/+13
| | | | | | | | | | | | | | | | | | | | | This commit adds support to discover garage instances running in kubernetes. Once enabled by setting `kubernetes_namespace` and `kubernetes_service_name` garage will create a Custom Resources `garagenodes.deuxfleurs.fr` with nodes public key as the resource name. and IP and Port information as spec in the namespace configured by `kubernetes_namespace`. For discovering nodes the resources are filtered with the optionally set `kubernetes_service_name` which sets a label `garage.deuxfleurs.fr/service` on the resources. This allows to separate multiple garage deployments in a single namespace. the `kubernetes_skip_crd` variable allows to disable the creation of the CRD by garage itself. The user must deploy this manually.
* Implement {Put,Get,Delete}BucketCors and CORS in generalAlex Auvolat2022-01-241-0/+12
| | | | | | - OPTIONS request against API endpoint - Returning corresponding CORS headers on API calls - Returning corresponding CORS headers on website GET's
* Make use of website config, return error document on errorAlex Auvolat2022-01-131-2/+0
|
* New buckets for 0.6.0: small changesAlex Auvolat2022-01-042-9/+1
| | | | | | | | | | | | - Fix bucket delete - fix merge of bucket creation date - Replace deletable with option in aliases Rationale: if two aliases point to conflicting bucket, resolving by making an arbitrary choice risks making data accessible when it shouldn't be. We'd rather resolve to deleting the alias until someone puts it back.
* Some movement of helper code and refactoring of error handlingAlex Auvolat2022-01-041-2/+8
|
* New buckets for 0.6.0: fix model and migrationAlex Auvolat2022-01-044-13/+36
|
* Add must_use to some CRDT functionsAlex Auvolat2022-01-043-1/+3
|
* New buckets for 0.6.0: documentation and build filesAlex Auvolat2022-01-041-0/+11
|
* New buckets for 0.6.0: small fixes, including:Alex Auvolat2022-01-043-20/+54
| | | | | | | | - ensure bucket names are correct aws s3 names - when making aliases, ensure timestamps of links in both ways are the same - fix small remarks by trinity - don't have a separate website_access field
* Model changesAlex Auvolat2022-01-041-0/+11
|
* New model for bucketsAlex Auvolat2022-01-047-5/+122
|
* Add compression using zstd (#173)trinity-1686a2021-12-151-0/+61
| | | | | | | | | fix #27 Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/173 Co-authored-by: trinity-1686a <trinity.pointard@gmail.com> Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
* Improve how node roles are assigned in Garagev0.5-beta1Alex Auvolat2021-11-168-1/+517
| | | | | | | | | | | | | | | | | - change the terminology: the network configuration becomes the role table, the configuration of a nodes becomes a node's role - the modification of the role table takes place in two steps: first, changes are staged in a CRDT data structure. Then, once the user is happy with the changes, they can commit them all at once (or revert them). - update documentation - fix tests - implement smarter partition assignation algorithm This patch breaks the format of the network configuration: when migrating, the cluster will be in a state where no roles are assigned. All roles must be re-assigned and commited at once. This migration should not pose an issue.
* add support for vhost-style s3 bucketTrinity Pointard2021-11-161-0/+3
|
* allow missing bootstrap_peers in garage.tomlTrinity Pointard2021-11-051-1/+1
|
* Add tranquilizer mechanism to improve on token bucket mechanismtranquilityAlex Auvolat2021-11-042-0/+58
|
* Add semaphore to limit RAM used by buffered outgoing requestsrequest-buffer-semaphoreAlex Auvolat2021-11-031-0/+3
|
* Refactoring on repair commandscli-verify-integrityAlex Auvolat2021-10-272-0/+41
|
* Use published netapp crate instead of git repoAlex Auvolat2021-10-261-1/+3
|
* Improve CLI, adapt tests, update documentationAlex Auvolat2021-10-253-16/+45
|
* Improvements to CLI and various fixes for netapp versionAlex Auvolat2021-10-223-48/+72
| | | | Discovery via consul, persist peer list to file
* First port of Garage to NetappAlex Auvolat2021-10-223-43/+36
|
* Prepare for v0.3.0 and add migration path from v0.2.1.xv0.3.0Alex Auvolat2021-05-281-1/+1
|
* Many improvements on ring/replication and its configuration:Alex Auvolat2021-05-281-28/+18
| | | | | | | | | | | | | | | | | | | | - Explicit "replication_mode" configuration parameters that takes either "none", "2" or "3" as values, instead of letting user configure replication factor themselves. These are presets whose corresponding replication/quorum values can be found in replication/mode.rs - Explicit support for single-node and two-node deployments (number of nodes must be at least "replication_mode", with "none" we can have only one node) - Ring is now stored much more compactly with 256*8 + n*32 bytes, instead of 256*32 bytes - Support for gateway-only nodes that do not store data (these nodes still need a metadata_directory to store the list of bucket and keys since those are stored on all nodes; it also technically needs a data_directory to start but it will stay empty unless we have bugs)
* Improved XML serializationbetter_xmlAlex Auvolat2021-05-061-1/+1
| | | | | | - Use quick_xml and serde for all XML response returned by the S3 API. - Include tests for all structs used to generate XML - Remove old manual XML escaping function which was unsafe
* rename types to CamelCaseTrinity Pointard2021-05-033-17/+16
|
* fix clippy warnings on util and rpcTrinity Pointard2021-05-034-6/+7
|
* Tune Sled configurationAlex Auvolat2021-05-031-0/+14
| | | | | | | - Make sled cache size and flush interval configurable - Set less agressive default values: - cache size 128MB instead of 1GB - Flush interval 2 seconds instead of .5 seconds
* make most requested changesTrinity Pointard2021-04-272-2/+0
|
generated by cgit v1.2.3 (git 2.25.1) at 2024-09-20 21:49:00 +0000