4 ms·

OP here! Richard Hipp, of sqlite fame, has announced that the sqlite project plans to reimplement its canonical build process in the 3.48 release cycle. The pr

by sgbeal 2y ago

OP here! Richard Hipp, of sqlite fame, has announced that the sqlite project plans to reimplement its canonical build process in the 3.48 release cycle. The project will, if all goes as planned, be moving away from the GNU Autotools and towards Steve Bennett's Autosetup, which we've used to good effect since 2011 in SQLite's sibling project, the Fossil SCM. The primary motivation behind this HN post is to draw eyes to what Richard points out in the linked forum post: this port _will_ break some folks' build processes and we'd like to know, in advance, what we'll be breaking so that we can make that transition as painless as we can. If you do "unusual" things with the SQLite build, please let us know about it (preferably in the linked-to forum, as that's less likely to be overlooked than comments on HN are, but we'll be following this thread for at least a few days for those of you who would prefer to voice your thoughts here).

ChoHag 2y ago
[dead]
westurner 2y ago
Conda-forge/sqlite-feedstock; recipe/meta.yml, recipe/build.sh: https://github.com/conda-forge/sqlite-feedstock/blob/main/recipe/build.sh https://github.com/conda-forge/sqlite-feedstock/blob/main/re... recipe/build.bat: https://github.com/conda-forge/sqlite-feedstock/blob/main/recipe/bld.bat https://github.com/conda-forge/sqlite-feedstock/blob/main/re... Is there a [multi-stage] Dockerfile to build, install and test SQLite with the new build system? Is there SLSA signing for the SQLite build artifacts? There should be a way to sign OBS Open Build Service packages with sigstore.dev's Cosign to Rekor, too IIUC. slsa-framework/slsa-github-generator: https://github.com/slsa-framework/slsa-github-generator https://github.com/slsa-framework/slsa-github-generator
- sgbeal 2y ago
  > Conda-forge/sqlite-feedstock; recipe/meta.yml, Aside from the cross-compilation, which is most definitely part of the process but has not yet been explored in depth[^1], nothing in your build immediately sticks out at as problematic, but i've bookmarked it for future reference during the port. The .bat build (Windows) will not change via this port. Only Unix-like environments will potentially be affected. > Is there a [multi-stage] Dockerfile to build, install and test SQLite with the new build system? Not that the sqlite project maintains, no. None of us use docker in any capacity. We work only from the canonical source tree and we like to think that it's easy enough to do that other folks can too. > Is there SLSA signing for the SQLite build artifacts? That's out of scope for, and unrelated to, this particular sub-project. > slsa-framework/slsa-github-generator: https://github.com/slsa-framework/slsa-github-generator https://github.com/slsa-framework/slsa-github-generator says: > This repository contains free tools to generate and verify SLSA Build Level 3 provenance for native GitHub projects using GitHub Actions. We don't use github except to post a read-only mirror of the canonical source tree. [^1]: Autosetup has strong support for cross-compilation, it just hasn't yet been tested in the being-ported build process.
  - westurner 2y ago
    You can sign built artifacts with cosign without actions or podman[-desktop]/docker. It's probably possible to trigger gh actions or gl pipelines builds (container, command) with git repo mirroring. datasette-lite depends on a WASM build of SQLite; what about WASM and e.g. emscripten-forge and micromamba? Edit emscripten-forge/recipes/recipes_emscripten/SQLite/build.sh: https://github.com/emscripten-forge/recipes/blob/main/recipes/recipes_emscripten/sqlite/build.sh https://github.com/emscripten-forge/recipes/blob/main/recipe... ... recipe.yml says 2022: https://github.com/emscripten-forge/recipes/blob/main/recipes/recipes_emscripten/sqlite/recipe.yaml https://github.com/emscripten-forge/recipes/blob/main/recipe...
    - sgbeal 2y ago
      > You can sign built artifacts with cosign without actions or podman[-desktop]/docker. That's all out of scope for, and unrelated to, this build port. > It's probably possible to trigger gh actions or gl pipelines builds (container, command) with git repo mirroring. We maintain our own SCM, which keeps us far removed from the github ways of doing things. None of the SQLite project members actively use github beyond posting the read-only project mirror and occasionally cloning other projects and/or participating in tickets, and that's unlikely to change in any foreseeable future. > emscripten-forge/recipes/recipes_emscripten/SQLite/build.sh: Thank you - bookmarked for later perusal and testing.
      - westurner 2y ago
        Same. Thanks What about extensions; does the new build port affect extensions? /? hnlog sqlite (190+ mentions) From https://news.ycombinator.com/item?id=40837610#40842365 https://news.ycombinator.com/item?id=40837610#40842365 : - > There are many extensions of SQLite; rqlite (Raft in Go,), cr-sqlite (CRDT in C), postlite (Postgres wire protocol for SQLite), electricsql (Postgres), sqledge (Postgres), and also WASM: sqlite-wasm, sqlite-wasm-http, dqlite (Raft in Rust), awesome-sqlite
        sgbeal 2y ago
fhdsgbbcaA 2y ago
.
- sgbeal 2y ago
  > ... you may want to repost again in 12 hours for more eyes. Duplicate threads are a plague ;). Posting a second time will only lead to chaos as i try to juggle multiple threads while continuing work on the posted-about build port.
- billfruit 2y ago
  Isn't Bangalore as important as California.

by sgbeal 2y ago

ChoHag 2y ago

[dead]

westurner 2y ago

Conda-forge/sqlite-feedstock; recipe/meta.yml, recipe/build.sh: https://github.com/conda-forge/sqlite-feedstock/blob/main/recipe/build.sh https://github.com/conda-forge/sqlite-feedstock/blob/main/re... recipe/build.bat: https://github.com/conda-forge/sqlite-feedstock/blob/main/recipe/bld.bat https://github.com/conda-forge/sqlite-feedstock/blob/main/re... Is there a [multi-stage] Dockerfile to build, install and test SQLite with the new build system? Is there SLSA signing for the SQLite build artifacts? There should be a way to sign OBS Open Build Service packages with sigstore.dev's Cosign to Rekor, too IIUC. slsa-framework/slsa-github-generator: https://github.com/slsa-framework/slsa-github-generator https://github.com/slsa-framework/slsa-github-generator

sgbeal 2y ago
> Conda-forge/sqlite-feedstock; recipe/meta.yml, Aside from the cross-compilation, which is most definitely part of the process but has not yet been explored in depth[^1], nothing in your build immediately sticks out at as problematic, but i've bookmarked it for future reference during the port. The .bat build (Windows) will not change via this port. Only Unix-like environments will potentially be affected. > Is there a [multi-stage] Dockerfile to build, install and test SQLite with the new build system? Not that the sqlite project maintains, no. None of us use docker in any capacity. We work only from the canonical source tree and we like to think that it's easy enough to do that other folks can too. > Is there SLSA signing for the SQLite build artifacts? That's out of scope for, and unrelated to, this particular sub-project. > slsa-framework/slsa-github-generator: https://github.com/slsa-framework/slsa-github-generator https://github.com/slsa-framework/slsa-github-generator says: > This repository contains free tools to generate and verify SLSA Build Level 3 provenance for native GitHub projects using GitHub Actions. We don't use github except to post a read-only mirror of the canonical source tree. [^1]: Autosetup has strong support for cross-compilation, it just hasn't yet been tested in the being-ported build process.
- westurner 2y ago
  You can sign built artifacts with cosign without actions or podman[-desktop]/docker. It's probably possible to trigger gh actions or gl pipelines builds (container, command) with git repo mirroring. datasette-lite depends on a WASM build of SQLite; what about WASM and e.g. emscripten-forge and micromamba? Edit emscripten-forge/recipes/recipes_emscripten/SQLite/build.sh: https://github.com/emscripten-forge/recipes/blob/main/recipes/recipes_emscripten/sqlite/build.sh https://github.com/emscripten-forge/recipes/blob/main/recipe... ... recipe.yml says 2022: https://github.com/emscripten-forge/recipes/blob/main/recipes/recipes_emscripten/sqlite/recipe.yaml https://github.com/emscripten-forge/recipes/blob/main/recipe...
  - sgbeal 2y ago
    > You can sign built artifacts with cosign without actions or podman[-desktop]/docker. That's all out of scope for, and unrelated to, this build port. > It's probably possible to trigger gh actions or gl pipelines builds (container, command) with git repo mirroring. We maintain our own SCM, which keeps us far removed from the github ways of doing things. None of the SQLite project members actively use github beyond posting the read-only project mirror and occasionally cloning other projects and/or participating in tickets, and that's unlikely to change in any foreseeable future. > emscripten-forge/recipes/recipes_emscripten/SQLite/build.sh: Thank you - bookmarked for later perusal and testing.
    - westurner 2y ago
      Same. Thanks What about extensions; does the new build port affect extensions? /? hnlog sqlite (190+ mentions) From https://news.ycombinator.com/item?id=40837610#40842365 https://news.ycombinator.com/item?id=40837610#40842365 : - > There are many extensions of SQLite; rqlite (Raft in Go,), cr-sqlite (CRDT in C), postlite (Postgres wire protocol for SQLite), electricsql (Postgres), sqledge (Postgres), and also WASM: sqlite-wasm, sqlite-wasm-http, dqlite (Raft in Rust), awesome-sqlite
      - sgbeal 2y ago

fhdsgbbcaA 2y ago

sgbeal 2y ago
> ... you may want to repost again in 12 hours for more eyes. Duplicate threads are a plague ;). Posting a second time will only lead to chaos as i try to juggle multiple threads while continuing work on the posted-about build port.
billfruit 2y ago
Isn't Bangalore as important as California.