aboutsummaryrefslogtreecommitdiff
path: root/shell.nix
Commit message (Collapse)AuthorAgeFilesLines
* nix, ci: build with CraneAlex Auvolat7 days1-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This removes our dependency on cargo2nix, which was causing us some issues. Whereas cargo2nix creates one Nix derivation per crate, Crane uses only two derivations: 1. Build dependencies only 2. Build the final binary This means that during the second step, no caching can be done. For instance, if we do a change in garage_model, we need to recompile all of the Garage crates including those that do not depend on garage_model. On the upside, this allows all of the Garage crates to be built at once using cargo build logic, which is optimized for high parallelism and better pipelining between all of the steps of the build. All in all, this makes most builds faster than cargo2nix. A few other changes have been made to the build scripts and CI: - Unit tests are now run within a Nix derivation. In fact, we have different derivations to run the tests using LMDB and Sqlite as metadata db engines. - For debug builds, most CI steps now run in parallel (with the notable exception of the smoke test that runs after the build, which is inevitable). - We no longer pass the GIT_VERSION argument when building debug builds and running the tests. This means that dev binaries and test binaries don't know the exact version of Garage they are from. That shouldn't be an issue in most cases. - The not-dynamic.sh scripts has been fixed to fail if the file does not exist.
* nix build: remove clippy build env that doesn't workAlex Auvolat2025-01-121-1/+1
|
* shell.nix: expose devShellFullFlorian Klink2024-04-231-0/+1
| | | | This allows accessing devShells.full from shell.nix.
* [nix-improvements] special case for Docker's "386" architecturenix-improvementsAlex Auvolat2024-02-091-2/+2
|
* [nix-improvements] get rid of DroneAlex Auvolat2024-02-091-9/+0
|
* [nix-improvements] use kaniko and manifest-tools from nixpkgs, simplifyAlex Auvolat2024-02-091-24/+2
|
* [nix-improvements] modernize Nix infrastructureAlex Auvolat2024-02-091-74/+61
|
* [woodpecker] convert drone pipelines to woodpeckerAlex Auvolat2024-02-081-0/+9
|
* nix: add clang to flake.nix and shell.nixAlex Auvolat2023-10-261-0/+1
|
* use mold linker when invoking cargo manually (not in nix build scripts)mold-linkerAlex Auvolat2023-10-101-10/+11
|
* Apply nixfmt to all .nix files; fix devshell and add it to cacheAlex Auvolat2023-01-261-157/+146
|
* Inject last modified date as git_version; flake cache uploadingnix-remove-systemAlex Auvolat2022-11-161-1/+13
|
* Make repository into a Nix flakeAlex Auvolat2022-11-161-1/+1
|
* Add function to upload a build and its dependencies to the cacheupgrade-toolchainAlex Auvolat2022-10-181-0/+12
| | | | to faster bootstrap new runner nodes
* Some things are now in result-binAlex Auvolat2022-10-181-1/+1
|
* move refresh_toolchainAlex Auvolat2022-10-181-10/+9
|
* Add step to generate multi-arch Docker container in CImulti-arch-containerAlex Auvolat2022-09-261-0/+30
|
* Run clippy in nix, leveraging nix caching abilityQuentin Dufour2022-07-261-7/+7
|
* Fail if compiled binary is dynamicQuentin Dufour2022-07-261-45/+59
|
* Add a K2V client library and CLI (#303)trinity-1686a2022-05-181-0/+2
| | | | | | | | | lib.rs could use getting split in modules, but I'm not sure how exactly Co-authored-by: trinity-1686a <trinity@deuxfleurs.fr> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/303 Co-authored-by: trinity-1686a <trinity.pointard@gmail.com> Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
* Remove strum crate dependency; add protobuf nix dependencyAlex Auvolat2022-03-141-0/+1
|
* add support for kubernetes service discoveryMax Audron2022-03-121-0/+1
| | | | | | | | | | | | | | | | | | | | | This commit adds support to discover garage instances running in kubernetes. Once enabled by setting `kubernetes_namespace` and `kubernetes_service_name` garage will create a Custom Resources `garagenodes.deuxfleurs.fr` with nodes public key as the resource name. and IP and Port information as spec in the namespace configured by `kubernetes_namespace`. For discovering nodes the resources are filtered with the optionally set `kubernetes_service_name` which sets a label `garage.deuxfleurs.fr/service` on the resources. This allows to separate multiple garage deployments in a single namespace. the `kubernetes_skip_crd` variable allows to disable the creation of the CRD by garage itself. The user must deploy this manually.
* Test WinSCPtest/winscpQuentin Dufour2022-03-031-1/+3
|
* Add integration tests to DroneQuentin Dufour2022-02-101-1/+1
|
* Upgrade cargo2nixQuentin Dufour2022-02-101-1/+1
|
* Generate and upload a JSON resultQuentin Dufour2022-02-051-3/+9
|
* Implement ListMultipartUploads (#171)Quentin2022-01-121-0/+1
| | | | | | | | | | | | | | | | | | | | | | | Implement ListMultipartUploads, also refactor ListObjects and ListObjectsV2. It took me some times as I wanted to propose the following things: - Using an iterator instead of the loop+goto pattern. I find it easier to read and it should enable some optimizations. For example, when consuming keys of a common prefix, we do many [redundant checks](https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/main/src/api/s3_list.rs#L125-L156) while the only thing to do is to [check if the following key is still part of the common prefix](https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/feature/s3-multipart-compat/src/api/s3_list.rs#L476). - Try to name things (see ExtractionResult and RangeBegin enums) and to separate concerns (see ListQuery and Accumulator) - An IO closure to make unit tests possibles. - Unit tests, to track regressions and document how to interact with the code - Integration tests with `s3api`. In the future, I would like to move them in Rust with the aws rust SDK. Merging of the logic of ListMultipartUploads and ListObjects was not a goal but a consequence of the previous modifications. Some points that we might want to discuss: - ListObjectsV1, when using pagination and delimiters, has a weird behavior (it lists multiple times the same prefix) with `aws s3api` due to the fact that it can not use our optimization to skip the whole prefix. It is independant from my refactor and can be tested with the commented `s3api` tests in `test-smoke.sh`. It probably has the same weird behavior on the official AWS S3 implementation. - Considering ListMultipartUploads, I had to "abuse" upload id marker to support prefix skipping. I send an `upload-id-marker` with the hardcoded value `include` to emulate your "including" token. - Some ways to test ListMultipartUploads with existing software (my tests are limited to s3api for now). Co-authored-by: Quentin Dufour <quentin@deuxfleurs.fr> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/171 Co-authored-by: Quentin <quentin@dufour.io> Co-committed-by: Quentin <quentin@dufour.io>
* Extract toolchain build from the CIbug/rust-muslQuentin Dufour2021-10-291-2/+22
|
* Use Rust binaries from Nix instead of rustupQuentin Dufour2021-10-291-5/+9
|
* Build Garage with Nixfeature/staticQuentin Dufour2021-10-191-0/+69
generated by cgit v1.2.3 (git 2.25.1) at 2025-02-10 22:24:22 +0000