[server] Publish docker image - Part 1 (#1218)
- Outline the plan - Add a first cut of the publish script Merging this now so that I can test the workflow. Post a successful publish, I'll open another PR with any fixes entailed, and will also document this in the main server README.
This commit is contained in:
commit
a8a2e7aee3
4 changed files with 146 additions and 4 deletions
35
.github/workflows/server-publish.yml
vendored
Normal file
35
.github/workflows/server-publish.yml
vendored
Normal file
|
@ -0,0 +1,35 @@
|
|||
name: "Publish (server)"
|
||||
|
||||
on:
|
||||
# Run manually, providing it the commit.
|
||||
#
|
||||
# To obtain the commit from the currently deployed museum, do:
|
||||
# curl -s https://api.ente.io/ping | jq -r '.id'
|
||||
workflow_dispatch:
|
||||
inputs:
|
||||
commit:
|
||||
description: "Commit to publish the image from"
|
||||
type: string
|
||||
required: true
|
||||
|
||||
jobs:
|
||||
build:
|
||||
runs-on: ubuntu-latest
|
||||
steps:
|
||||
- name: Checkout code @ ${{ inputs.commit }}
|
||||
uses: actions/checkout@v4
|
||||
with:
|
||||
ref: ${{ inputs.commit }}
|
||||
|
||||
- name: Build and push
|
||||
uses: mr-smithers-excellent/docker-build-push@v6
|
||||
with:
|
||||
dockerfile: server/Dockerfile
|
||||
directory: server
|
||||
image: ghcr.io/ente-io/server
|
||||
registry: ghcr.io
|
||||
enableBuildKit: true
|
||||
buildArgs: GIT_COMMIT=${GITHUB_SHA}
|
||||
tags: ${GITHUB_SHA}, latest
|
||||
username: ${{ github.actor }}
|
||||
password: ${{ secrets.GITHUB_TOKEN }}
|
8
.github/workflows/server-release.yml
vendored
8
.github/workflows/server-release.yml
vendored
|
@ -7,11 +7,11 @@ jobs:
|
|||
build:
|
||||
runs-on: ubuntu-latest
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
name: Check out code
|
||||
- name: Checkout code
|
||||
uses: actions/checkout@v4
|
||||
|
||||
- uses: mr-smithers-excellent/docker-build-push@v6
|
||||
name: Build & Push
|
||||
- name: Build and push
|
||||
uses: mr-smithers-excellent/docker-build-push@v6
|
||||
with:
|
||||
dockerfile: server/Dockerfile
|
||||
directory: server
|
||||
|
|
70
server/docs/docker.md
Normal file
70
server/docs/docker.md
Normal file
|
@ -0,0 +1,70 @@
|
|||
# Running using published Docker images
|
||||
|
||||
Here we describe a way to run an Ente instance using a starter Docker compose
|
||||
file and using the pre-built Docker images that we publish. This method does not
|
||||
require you to clone the repository or build any images.
|
||||
|
||||
1. Create a directory where you'll run Ente
|
||||
|
||||
```sh
|
||||
mkdir ente && cd ente
|
||||
```
|
||||
|
||||
2. Copy the starter compose.yaml (and two of its support files) from the
|
||||
repository onto your directory. You can do it by hand, or use (e.g.) curl
|
||||
|
||||
```sh
|
||||
# compose.yaml
|
||||
curl -LO https://raw.githubusercontent.com/ente-io/ente/main/server/compose.yaml
|
||||
|
||||
mkdir -p scripts/compose
|
||||
cd scripts/compose
|
||||
|
||||
# scripts/compose/credentials.yaml
|
||||
curl -LO https://raw.githubusercontent.com/ente-io/ente/main/server/scripts/compose/credentials.yaml
|
||||
|
||||
# scripts/compose/minio-provision.sh
|
||||
curl -LO https://raw.githubusercontent.com/ente-io/ente/main/server/scripts/compose/minio-provision.sh
|
||||
|
||||
cd ../..
|
||||
```
|
||||
|
||||
3. Modify `compose.yaml`. Instead of building from source, we want directly use
|
||||
the published Docker image from `ghcr.io/ente-io/server`
|
||||
|
||||
```diff
|
||||
--- a/server/compose.yaml
|
||||
+++ b/server/compose.yaml
|
||||
@@ -1,9 +1,6 @@
|
||||
services:
|
||||
museum:
|
||||
- build:
|
||||
- context: .
|
||||
- args:
|
||||
- GIT_COMMIT: development-cluster
|
||||
+ image: ghcr.io/ente-io/server
|
||||
```
|
||||
|
||||
4. Create an (empty) configuration file. Yyou can later put your custom
|
||||
configuration in this if needed.
|
||||
|
||||
```sh
|
||||
touch museum.yaml
|
||||
```
|
||||
|
||||
4. That is all. You can now start everything.
|
||||
|
||||
```sh
|
||||
docker compose up
|
||||
```
|
||||
|
||||
This will start a cluster containing:
|
||||
|
||||
* Ente's own server
|
||||
* PostgresQL (DB)
|
||||
* MinIO (the S3 layer)
|
||||
|
||||
For each of these, it'll use the latest published Docker image.
|
||||
|
||||
Alternatively, if you only want to run Ente's server, you can directly pull and
|
||||
run the image we publish to **`ghcr.io/ente-io/server`**.
|
37
server/docs/publish.md
Normal file
37
server/docs/publish.md
Normal file
|
@ -0,0 +1,37 @@
|
|||
# Publishing images
|
||||
|
||||
There are two different images we publish - internal and external.
|
||||
|
||||
## Internal
|
||||
|
||||
The internal images can be built and run by triggering the "Server (release)"
|
||||
workflow. You can trigger it either from GitHub's UI on the Actions tab, or use
|
||||
the following command:
|
||||
|
||||
gh workflow run server-release.yml
|
||||
|
||||
This will take the latest main, package it into a Docker image, and publish it
|
||||
to our Scaleway registry. From there, we can update our production instances to
|
||||
use this new image (see [deploy/README](../scripts/deploy/README.md)).
|
||||
|
||||
## External
|
||||
|
||||
Periodically, we can republish a new image from an existing known-to-be-good
|
||||
commit to the GitHub Container Registry (GHCR) so that it can be used by folks
|
||||
without needing to clone our repository just for building an image. For more
|
||||
details about the use case, see [docker.md](docker.md).
|
||||
|
||||
To publish such an external image, firstly find the commit of the currently
|
||||
running production instance.
|
||||
|
||||
curl -s https://api.ente.io/ping | jq -r '.id'
|
||||
|
||||
> We can publish from any arbitrary commit really, but by using the commit
|
||||
> that's already seen production for a few days, we avoid externally publishing
|
||||
> images with issues.
|
||||
|
||||
Then, trigger the "Publish (server)" workflow, providing it the commit. You can
|
||||
trigger it either from GitHub's UI or using the `gh cli`. With the CLI, we can
|
||||
combine both these steps too.
|
||||
|
||||
Once the workflow completes, the resultant image will be available at `ghcr.io/ente-io/server`.
|
Loading…
Add table
Reference in a new issue