aboutsummaryrefslogtreecommitdiff
path: root/src/model/garage.rs
Commit message (Collapse)AuthorAgeFilesLines
* Implement CreateKey, DeleteKey and rudimentary UpdateKeyAlex Auvolat2022-05-111-0/+4
|
* First implementation of K2V (#293)Alex2022-05-101-20/+77
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | **Specification:** View spec at [this URL](https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/k2v/doc/drafts/k2v-spec.md) - [x] Specify the structure of K2V triples - [x] Specify the DVVS format used for causality detection - [x] Specify the K2V index (just a counter of number of values per partition key) - [x] Specify single-item endpoints: ReadItem, InsertItem, DeleteItem - [x] Specify index endpoint: ReadIndex - [x] Specify multi-item endpoints: InsertBatch, ReadBatch, DeleteBatch - [x] Move to JSON objects instead of tuples - [x] Specify endpoints for polling for updates on single values (PollItem) **Implementation:** - [x] Table for K2V items, causal contexts - [x] Indexing mechanism and table for K2V index - [x] Make API handlers a bit more generic - [x] K2V API endpoint - [x] K2V API router - [x] ReadItem - [x] InsertItem - [x] DeleteItem - [x] PollItem - [x] ReadIndex - [x] InsertBatch - [x] ReadBatch - [x] DeleteBatch **Testing:** - [x] Just a simple Python script that does some requests to check visually that things are going right (does not contain parsing of results or assertions on returned values) - [x] Actual tests: - [x] Adapt testing framework - [x] Simple test with InsertItem + ReadItem - [x] Test with several Insert/Read/DeleteItem + ReadIndex - [x] Test all combinations of return formats for ReadItem - [x] Test with ReadBatch, InsertBatch, DeleteBatch - [x] Test with PollItem - [x] Test error codes - [ ] Fix most broken stuff - [x] test PollItem broken randomly - [x] when invalid causality tokens are given, errors should be 4xx not 5xx **Improvements:** - [x] Descending range queries - [x] Specify - [x] Implement - [x] Add test - [x] Batch updates to index counter - [x] Put K2V behind `k2v` feature flag Co-authored-by: Alex Auvolat <alex@adnab.me> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/293 Co-authored-by: Alex <alex@adnab.me> Co-committed-by: Alex <alex@adnab.me>
* ClippyAlex Auvolat2022-03-231-4/+3
|
* Make background tranquility a configurable parameterAlex Auvolat2022-03-231-6/+9
|
* Move DataBlock out of manager.rsAlex Auvolat2022-03-231-3/+0
|
* Move block manager to separate moduleAlex Auvolat2022-03-231-8/+5
|
* Some movement of helper code and refactoring of error handlingAlex Auvolat2022-01-041-3/+3
|
* New model for bucketsAlex Auvolat2022-01-041-0/+17
|
* Make table name a const in traitAlex Auvolat2021-12-151-17/+2
|
* Improve CLI, adapt tests, update documentationAlex Auvolat2021-10-251-6/+1
|
* Improvements to CLI and various fixes for netapp versionAlex Auvolat2021-10-221-0/+6
| | | | Discovery via consul, persist peer list to file
* First port of Garage to NetappAlex Auvolat2021-10-221-27/+16
|
* Many improvements on ring/replication and its configuration:Alex Auvolat2021-05-281-8/+13
| | | | | | | | | | | | | | | | | | | | - Explicit "replication_mode" configuration parameters that takes either "none", "2" or "3" as values, instead of letting user configure replication factor themselves. These are presets whose corresponding replication/quorum values can be found in replication/mode.rs - Explicit support for single-node and two-node deployments (number of nodes must be at least "replication_mode", with "none" we can have only one node) - Ring is now stored much more compactly with 256*8 + n*32 bytes, instead of 256*32 bytes - Support for gateway-only nodes that do not store data (these nodes still need a metadata_directory to store the list of bucket and keys since those are stored on all nodes; it also technically needs a data_directory to start but it will stay empty unless we have bugs)
* fix clippy warnings on modelTrinity Pointard2021-05-031-5/+5
|
* attempt at documenting model crateTrinity Pointard2021-04-271-0/+9
|
* attempt at documenting table crateTrinity Pointard2021-04-271-2/+2
|
* Simplify replication logicAlex Auvolat2021-03-161-1/+6
|
* (not well tested) use merkle tree for syncAlex Auvolat2021-03-111-1/+1
|
* WIP big refactoringAlex Auvolat2021-03-111-2/+2
|
* Checkpoint: add merkle tree in data tableAlex Auvolat2021-03-111-12/+7
|
* Refactor model stuff, including cleaner CRDTsAlex Auvolat2021-03-101-1/+0
|
* Remove epidemic propagation for fully replicated stuff: write directly to ↵Alex Auvolat2021-03-051-4/+1
| | | | all nodes
* Rename garage_core to garage_modelAlex Auvolat2020-07-071-0/+166