Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | New version of the algorithm that calculate the layout. | Mendes | 2022-09-21 | 5 | -325/+918 |
| | | | | | | | | It takes as paramters the replication factor and the zone redundancy, computes the largest partition size reachable with these constraints, and among the possible assignation with this partition size, it computes the one that moves the least number of partitions compared to the previous assignation. This computation uses graph algorithms defined in graph_algo.rs | ||||
* | Correct small formatting issue | Alex Auvolat | 2022-05-05 | 1 | -3/+1 |
| | |||||
* | Corrected the warnings and errors issued by cargo clippy | Mendes | 2022-05-01 | 1 | -15/+11 |
| | |||||
* | Apply cargo fmt | Alex Auvolat | 2022-05-01 | 1 | -444/+496 |
| | |||||
* | Change the way new layout assignations are computed. | Alex Auvolat | 2022-05-01 | 2 | -434/+448 |
| | | | | | | The function now computes an optimal assignation (with respect to partition size) that minimizes the distance to the former assignation, using flow algorithms. This commit was written by Mendes Oulamara <mendes.oulamara@pm.me> | ||||
* | Update to netapp 0.4.2 (a tiny fix) | Alex Auvolat | 2022-04-07 | 1 | -1/+1 |
| | |||||
* | Add feature flag for Kubernetes discovery | Alex Auvolat | 2022-03-24 | 4 | -73/+108 |
| | |||||
* | Make layout optimization work in relative termsbug/layout | Alex Auvolat | 2022-03-24 | 1 | -9/+14 |
| | |||||
* | Slight change and add comment to layout assignation algo | Alex Auvolat | 2022-03-24 | 1 | -37/+33 |
| | |||||
* | Small change to partition assignation algorithm | Alex Auvolat | 2022-03-24 | 1 | -0/+28 |
| | | | | | | This change helps ensure that nodes for each partition are spread over all datacenters, a property that wasn't ensured previously when going from a 2 DC deployment to a 3 DC deployment | ||||
* | Update netapp to v0.4.1update-netapp | Alex Auvolat | 2022-03-15 | 1 | -1/+1 |
| | |||||
* | Fix some new clippy lintsfix-resync | Alex Auvolat | 2022-03-14 | 3 | -10/+5 |
| | |||||
* | Add wrapper over sled tree to count items (used for big queues) | Alex Auvolat | 2022-03-14 | 1 | -1/+6 |
| | |||||
* | Bump version to 0.7 because of incompatible Netapp | Alex Auvolat | 2022-03-14 | 2 | -4/+4 |
| | |||||
* | Add spans to table calls, change span names in RPC | Alex Auvolat | 2022-03-14 | 1 | -1/+15 |
| | |||||
* | add missing netapp telemetry feature | Alex Auvolat | 2022-03-14 | 1 | -1/+1 |
| | |||||
* | Refactoring: rename config files, make modifications less invasive | Alex Auvolat | 2022-03-14 | 1 | -137/+151 |
| | |||||
* | Add metrics to API endpoint | Alex Auvolat | 2022-03-14 | 1 | -3/+4 |
| | |||||
* | Refactor how durations are measured | Alex Auvolat | 2022-03-14 | 2 | -12/+6 |
| | |||||
* | Update to Netapp 0.4 which supports distributed tracing | Alex Auvolat | 2022-03-14 | 3 | -18/+13 |
| | |||||
* | Add tracing integration with opentelemetry | Alex Auvolat | 2022-03-14 | 4 | -135/+163 |
| | |||||
* | Add many metrics in table/ and rpc/ | Alex Auvolat | 2022-03-14 | 4 | -5/+95 |
| | |||||
* | add support for kubernetes service discovery | Max Audron | 2022-03-12 | 4 | -1/+206 |
| | | | | | | | | | | | | | | | | | | | | | This commit adds support to discover garage instances running in kubernetes. Once enabled by setting `kubernetes_namespace` and `kubernetes_service_name` garage will create a Custom Resources `garagenodes.deuxfleurs.fr` with nodes public key as the resource name. and IP and Port information as spec in the namespace configured by `kubernetes_namespace`. For discovering nodes the resources are filtered with the optionally set `kubernetes_service_name` which sets a label `garage.deuxfleurs.fr/service` on the resources. This allows to separate multiple garage deployments in a single namespace. the `kubernetes_skip_crd` variable allows to disable the creation of the CRD by garage itself. The user must deploy this manually. | ||||
* | Some movement of helper code and refactoring of error handling | Alex Auvolat | 2022-01-04 | 1 | -1/+1 |
| | |||||
* | New model for buckets | Alex Auvolat | 2022-01-04 | 1 | -2/+2 |
| | |||||
* | Improve how node roles are assigned in Garagev0.5-beta1 | Alex Auvolat | 2021-11-16 | 6 | -213/+674 |
| | | | | | | | | | | | | | | | | | - change the terminology: the network configuration becomes the role table, the configuration of a nodes becomes a node's role - the modification of the role table takes place in two steps: first, changes are staged in a CRDT data structure. Then, once the user is happy with the changes, they can commit them all at once (or revert them). - update documentation - fix tests - implement smarter partition assignation algorithm This patch breaks the format of the network configuration: when migrating, the cluster will be in a state where no roles are assigned. All roles must be re-assigned and commited at once. This migration should not pose an issue. | ||||
* | Request strategy: don't launch all 3 requests if not neededv0.4-rc2 | Alex Auvolat | 2021-11-04 | 2 | -45/+152 |
| | |||||
* | Add semaphore to limit RAM used by buffered outgoing requestsrequest-buffer-semaphore | Alex Auvolat | 2021-11-03 | 2 | -7/+31 |
| | |||||
* | Fix peer list persistence: do not forget previous peers | Alex Auvolat | 2021-11-03 | 1 | -7/+23 |
| | |||||
* | Use published netapp crate instead of git repo | Alex Auvolat | 2021-10-26 | 1 | -1/+2 |
| | |||||
* | Fix clippy lints (fix #121) | Alex Auvolat | 2021-10-26 | 1 | -1/+1 |
| | |||||
* | Improve CLI, adapt tests, update documentation | Alex Auvolat | 2021-10-25 | 2 | -56/+113 |
| | |||||
* | Improvements to CLI and various fixes for netapp version | Alex Auvolat | 2021-10-22 | 5 | -147/+348 |
| | | | | Discovery via consul, persist peer list to file | ||||
* | First port of Garage to Netapp | Alex Auvolat | 2021-10-22 | 9 | -1493/+589 |
| | |||||
* | Support pkcs8 private keys (allowing for ed25519 to be used for rpc) | Alex Auvolat | 2021-07-06 | 1 | -8/+9 |
| | |||||
* | exit when inconsistent level of replication is detected (#92) | trinity-1686a | 2021-06-02 | 1 | -0/+16 |
| | | | | | | | | | fix #88 Authored-by: Trinity Pointard <trinity.pointard@gmail.com> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/92 Co-authored-by: trinity-1686a <trinity.pointard@gmail.com> Co-committed-by: trinity-1686a <trinity.pointard@gmail.com> | ||||
* | make most changes suggested during install-party | Trinity Pointard | 2021-05-29 | 1 | -3/+7 |
| | |||||
* | Prepare for v0.3.0 and add migration path from v0.2.1.xv0.3.0 | Alex Auvolat | 2021-05-28 | 3 | -9/+45 |
| | |||||
* | Rename datacenters into zones (doc not yet updated) | Alex Auvolat | 2021-05-28 | 1 | -9/+9 |
| | |||||
* | Many improvements on ring/replication and its configuration: | Alex Auvolat | 2021-05-28 | 2 | -46/+114 |
| | | | | | | | | | | | | | | | | | | | | - Explicit "replication_mode" configuration parameters that takes either "none", "2" or "3" as values, instead of letting user configure replication factor themselves. These are presets whose corresponding replication/quorum values can be found in replication/mode.rs - Explicit support for single-node and two-node deployments (number of nodes must be at least "replication_mode", with "none" we can have only one node) - Ring is now stored much more compactly with 256*8 + n*32 bytes, instead of 256*32 bytes - Support for gateway-only nodes that do not store data (these nodes still need a metadata_directory to store the list of bucket and keys since those are stored on all nodes; it also technically needs a data_directory to start but it will stay empty unless we have bugs) | ||||
* | rename types to CamelCase | Trinity Pointard | 2021-05-03 | 5 | -35/+34 |
| | |||||
* | fix clippy warnings on util and rpc | Trinity Pointard | 2021-05-03 | 5 | -45/+38 |
| | |||||
* | change some more comments and revert changes on TableSchema | Trinity Pointard | 2021-04-27 | 2 | -3/+3 |
| | |||||
* | make most requested changes | Trinity Pointard | 2021-04-27 | 4 | -11/+14 |
| | |||||
* | remove useless comment | Alex Auvolat | 2021-04-27 | 1 | -1/+0 |
| | |||||
* | run cargo fmt on util and make missing doc warning | Trinity Pointard | 2021-04-27 | 1 | -1/+1 |
| | |||||
* | document rpc crate | Trinity Pointard | 2021-04-27 | 5 | -9/+99 |
| | |||||
* | small simplify | Alex Auvolat | 2021-04-27 | 1 | -3/+1 |
| | |||||
* | Merge discovery loop with consul | Alex Auvolat | 2021-04-27 | 1 | -37/+22 |
| | |||||
* | cargo fmt | Alex Auvolat | 2021-04-27 | 1 | -1/+0 |
| |