docs: GOA deb upgrades + monitoring notes

scripts/README.md

@@ -7,6 +7,7 @@
 | `taler-hacktivism-bank/` | podman `taler-hacktivism-bank`: `/root`, `/usr/local/bin` |
 | `taler-sanity/` | host root checks (stack, settlement, helpers) |
 | `taler-monitoring/` | **outside-in** public URL walk (`/config` → keys/terms/integration/webui) |
+| `taler-shared/` | shared helpers (`upgrade-goa-debs.sh` = apt upgrade **inside** bank/exchange/merchant containers) |
 | `monitoring/` | host `/home/hernani/scripts` (tor relay stats) |
 | `taler-wallet-cli/` | thin wrappers; **benchmarks live in** `../benchmarks/` |
 | `castopod/` | host `hernani` podman-compose `~/koopa-castopod` — see `castopod/README.md` |
@@ -44,4 +45,8 @@ Exchange one-shots (root, offline / wire):
 
 `runuser -u USER -- bash` (never `-u` with `-s` on util-linux).
 
+### Package upgrades (trixie debs inside containers)
+
+Containers are **not** systemd. After `apt-get install` of Taler/libeufin packages, restart with `start_*.sh` only — see **`taler-shared/upgrade-goa-debs.sh`** and day note `2026/2026-07-16--taler-package-upgrade-goa.md`. Host `zypper` does not update these.
+
 SMS helper symlinks into `/var/taler-src/...` are not copied (merchant only).

scripts/taler-monitoring/README.md

@@ -33,16 +33,67 @@ End of each phase: totals + list of **BLOCKERS** and **ERRORS**.
 # Other domains — public HTTPS only, never SSH
 ./taler-monitoring.sh -d taler.net
 ./taler-monitoring.sh --domain taler-ops.ch
+./taler-monitoring.sh -d my.taler-ops.ch urls
 ./taler-monitoring.sh -d demo.taler.net urls
 ./taler-monitoring.sh taler.net    # bare domain = same as -d
+
+# Explicit endpoints (any mix; override profile or skip -d)
+./taler-monitoring.sh --bank https://bank.demo.taler.net \
+  --exchange https://exchange.demo.taler.net \
+  --merchant https://backend.demo.taler.net --currency KUDOS urls
 ```
 
-| Domain | Bank | Exchange | Merchant | Currency |
-|--------|------|----------|----------|----------|
-| `hacktivism.ch` (default) | bank.hacktivism.ch | exchange.hacktivism.ch | taler.hacktivism.ch | GOA |
+## Domain profiles (`domains.conf`)
+
+Each monitored stack must say **what is bank, exchange, and merchant-backend**.
+
+Edit **[domains.conf](./domains.conf)** (or set `TALER_DOMAINS_CONF=`):
+
+```text
+# name   bank   exchange   merchant-backend   currency   local   [canonical]
+taler-ops.ch  bank.taler-ops.ch  exchange.taler-ops.ch  my.taler-ops.ch  CHF  0
+```
+
+| Field | Meaning |
+|-------|---------|
+| **name** | `-d NAME` / `TALER_DOMAIN` match (add alias lines as needed) |
+| **bank** | libeufin/bank public host or `https://…` |
+| **exchange** | exchange public host or URL |
+| **merchant** | merchant **backend** (SPA/API), e.g. `my.taler-ops.ch` |
+| **currency** | `GOA` / `KUDOS` / `CHF` / … |
+| **local** | `1` = koopa SSH stack; `0` = public only |
+| **landing** | `1` = check `/intro` landings + assets; `0` = skip (TOPS / mytops) |
+| **canonical** | optional label after alias (e.g. `my.taler-ops.ch` → `taler-ops.ch`) |
+
+Then:
+
+```bash
+./taler-monitoring.sh -d taler-ops.ch urls
+```
+
+Overrides (always win after profile load):
+
+```bash
+./taler-monitoring.sh -d taler-ops.ch \
+  --merchant https://my.taler-ops.ch \
+  --exchange https://exchange.taler-ops.ch \
+  --bank https://bank.taler-ops.ch urls
+```
+
+Helpers in `lib.sh`: `set_taler_stack`, `load_domain_profile`, `apply_taler_domain`.
+
+### Built-in profiles (see `domains.conf`)
+
+| Domain / alias | Bank | Exchange | Merchant | Currency |
+|----------------|------|----------|----------|----------|
+| `hacktivism.ch` / `koopa` | bank.hacktivism.ch | exchange.hacktivism.ch | taler.hacktivism.ch | GOA |
 | `taler.net` / `demo.taler.net` | bank.demo.taler.net | exchange.demo.taler.net | backend.demo.taler.net | KUDOS |
-| `taler-ops.ch` | bank.* (probe) | exchange.taler-ops.ch | backend.* (probe) | CHF |
-| other | bank.DOMAIN | exchange.DOMAIN | backend/taler/merchant (probe) | any |
+| `test.taler.net` | bank.test… | exchange.test… | backend.test… | **TESTKUDOS** · no landings |
+| `taler-ops.ch` / `my.taler-ops.ch` | bank.taler-ops.ch | exchange.taler-ops.ch | **my.taler-ops.ch** | CHF · **no landings** |
+| `stage.taler-ops.ch` | bank.stage… | exchange.stage… | **my.stage…** | CHF · **no landings** |
+| unknown | bank.DOMAIN | exchange.DOMAIN | my.DOMAIN then probe | any · no landings |
+
+**Landings:** only GOA (and optionally demo) use public `/intro` pages. **taler-ops.ch does not** — `CHECK_LANDING=0` in the profile skips intro crawl, shop assets, and demo-withdraw checks.
 
 **SSH only for koopa** (`hacktivism.ch` / `-d koopa`).
 
@@ -52,8 +103,9 @@ Other domains: never SSH. Optional **e2e** aborts cleanly on login/KYC.
 
 | | Local (koopa) | Remote |
 |--|---------------|--------|
-| **ATM withdraw** | 20 · 50 · 100 · 200 | 10 · 20 · 50 |
+| **ATM withdraw** | 20 · 50 · 100 · 200 · **4200** (paivana) | 10 · 20 · 50 |
 | **Pay ladder** | 0.01 … 10 | 0.01 … 1 |
+| **Paivana** | HTTP paywall + template pay **GOA:4200** (`goa-shop` / `paivana`) | skipped |
 
 ```bash
 ./taler-monitoring.sh e2e
@@ -66,6 +118,10 @@ E2E_VARIABLE=0 WITHDRAW_AMT=GOA:50 PAY_AMT=GOA:1 ./taler-monitoring.sh e2e   # s
 #   E2E_SHOP_PRODUCTS lines: id|Product name|GOA:amount
 #   E2E_SHOP_PICK_N=2
 #   (landing QR = taler://pay-template/…/{id}; popup = live taler://pay after POST templates/{id})
+# Paivana paywall (local GOA only):
+#   E2E_PAIVANA=1 (default)  PAIVANA_PUBLIC=https://paivana.hacktivism.ch
+#   E2E_PAIVANA_TEMPLATE=paivana  E2E_PAIVANA_AMOUNT=GOA:4200  E2E_PAIVANA_INSTANCE=goa-shop
+#   E2E_PAIVANA=0            # skip
 # remote secrets:
 #   E2E_BANK_ADMIN_PASS=…  E2E_MERCHANT_TOKEN=…
 ```

scripts/taler-monitoring/TESTS.md

@@ -43,12 +43,13 @@ IDs are assigned **in run order** within the area (`set_area` resets the counter
 | www-… | **merchant `/terms`** body (dual-currency notice) |
 | www-… | **merchant `/privacy`** body (must not be `not configured`) |
 | www-… | merchant `/terms/` redirect |
-| www-… | **landing exposed links** (bank / merchant / exchange): parse each `/intro/` HTML, probe every own-stack `https://` + root-relative `href`/`src`/`content`, soft-check external stores/docs |
-| www-… | landing static: `qrcode.min.js`, `og-goa-shop.png`, `qr-logo.png`, shop-pay.js/css |
-| www-… | cross-links between bank ↔ merchant ↔ exchange intros (local stack) |
+| www-… | **landing (aggregated per site)**: one line for bank/merchant/exchange (`/intro` + assets + own/external link counts); failures listed as samples; soft external/shop assets compact |
+| www-… | cross-links: one line (4 intros) on local stack |
+| www-… | bank demo-withdraw + shop assets: one line (+ soft shop-pay if missing) |
 | www-… | **bank `/intro/demo-withdraw.json`** → `taler://withdraw/HOST:PORT/taler-integration/…` + integration op HTTP 200 |
 | www-… | bank `/intro/auto-account.json` (earlier) → same withdraw shape, **no payto_uri**, login at `/webui/` |
-| www-… | **performance** (outside-in): public HTTPS RTT for bank `/config`, `/taler-integration/config`, `/webui/`, `/intro/`, `stats.json`; exchange `/config`, `/keys`, `/intro/`; merchant `/config`, `/webui/`, `/intro/` — report ms; WARN ≥ `PERF_WARN_MS` (default 8000); **ERROR ≥ `PERF_FAIL_MS` (default 20000)** |
+| www-… | **performance** (outside-in RTT): bank/exchange/merchant `/config`, keys, webui, intro — ms; WARN ≥ `PERF_WARN_MS` (8000); ERROR ≥ `PERF_FAIL_MS` (20000) |
+| www-… | **landing load stats**: `/intro/stats.json` → loadavg, container RSS, in-container probe ms (public; SSH container cat fallback); warn if stale/missing |
 
 **Legal docs rule:** HTTP 200, non-empty body, not plain `not configured`, not merchant API JSON `code:21`. On local stack, optional content needle (terms/privacy/FADP/GOA…).
 
@@ -135,6 +136,8 @@ Without SSH (`SKIP_SSH=1` or remote domain): still runs outside-in repo checks;
 
 ## e2e — payment path (`./taler-monitoring.sh e2e`)
 
+Local GOA also: **ATM includes GOA:4200**, then **paivana** (HTTP 302 on `PAIVANA_PUBLIC` + public template pay `paivana` / GOA:4200 on `goa-shop`). Disable with `E2E_PAIVANA=0`.
+
 | ID | Step (approx.) |
 |----|----------------|
 | e2e-001 | budget info |

scripts/taler-shared/upgrade-goa-debs.sh

@@ -0,0 +1,126 @@
+#!/usr/bin/env bash
+# Upgrade GNU Taler .deb packages *inside* the three GOA containers on koopa.
+# Host openSUSE packages are unrelated (zypper) — do not confuse with this.
+#
+# Containers (no systemd as PID 1): after apt, restart with start_*.sh only.
+#
+# Run on koopa host as a user that can `podman exec` the containers:
+#   ./upgrade-goa-debs.sh
+#   ./upgrade-goa-debs.sh bank|exchange|merchant
+#
+# Mirror: scripts/taler-shared/ in koopa-admin-log.
+# Live note: 2026/2026-07-16--taler-package-upgrade-goa.md
+set -euo pipefail
+
+BANK_CTR="${BANK_CTR:-taler-hacktivism-bank}"
+EXCHANGE_CTR="${EXCHANGE_CTR:-taler-hacktivism-exchange-ansible}"
+MERCHANT_CTR="${MERCHANT_CTR:-taler-hacktivism}"
+
+only="${1:-all}"
+
+pod_root() {
+  local ctr="$1"
+  shift
+  podman exec -u root "$ctr" bash -c "$*"
+}
+
+upgrade_bank() {
+  echo "======== bank ($BANK_CTR) ========"
+  pod_root "$BANK_CTR" '
+    set -e
+    export DEBIAN_FRONTEND=noninteractive
+    apt-get update -qq
+    apt-get install -y libeufin-bank libeufin-common
+    dpkg -l libeufin-bank libeufin-common | awk "/^ii/{print \$2,\$3}"
+  '
+  # restart app only (postgres via start_base if needed)
+  pod_root "$BANK_CTR" '
+    set -e
+    if ! runuser -u postgres -- psql -c "SELECT 1" >/dev/null 2>&1; then
+      pg_ctlcluster 17 main start || true
+      sleep 2
+    fi
+    mkdir -p /var/log/libeufin-bank
+    chown libeufin-bank:libeufin-bank /var/log/libeufin-bank 2>/dev/null || true
+    runuser -u libeufin-bank -- /usr/local/bin/start_bank.sh --restart
+  '
+}
+
+upgrade_exchange() {
+  echo "======== exchange ($EXCHANGE_CTR) ========"
+  pod_root "$EXCHANGE_CTR" '
+    set -e
+    export DEBIAN_FRONTEND=noninteractive
+    apt-get update -qq
+    apt-get install -y \
+      taler-exchange taler-exchange-database taler-exchange-offline \
+      taler-exchange-typst libtalerexchange taler-terms-generator \
+      taler-exchange-aml-webui taler-exchange-kyc-webui || true
+    dpkg -l "taler-exchange*" "libtalerexchange" "taler-terms-generator" 2>/dev/null \
+      | awk "/^ii/{print \$2,\$3}"
+  '
+  # do not run dbinit as root (role "root" does not exist)
+  pod_root "$EXCHANGE_CTR" '
+    set -e
+    if id taler-exchange-httpd >/dev/null 2>&1; then
+      runuser -u taler-exchange-httpd -- taler-exchange-dbinit 2>&1 | tail -20 || true
+    fi
+    if [ -x /root/start_base_services_for_taler_exchange.sh ]; then
+      /root/start_base_services_for_taler_exchange.sh --no-shell 2>/dev/null || true
+    fi
+    if [ -x /usr/local/bin/start_exchange.sh ]; then
+      runuser -u taler-exchange-httpd -- /usr/local/bin/start_exchange.sh --restart 2>&1 | tail -30 || true
+    fi
+    pgrep -a taler-exchange-httpd | head -3 || true
+  '
+}
+
+upgrade_merchant() {
+  echo "======== merchant ($MERCHANT_CTR) ========"
+  pod_root "$MERCHANT_CTR" '
+    set -e
+    export DEBIAN_FRONTEND=noninteractive
+    apt-get update -qq
+    apt-get install -y \
+      taler-merchant taler-merchant-webui taler-merchant-typst \
+      libtalermerchant taler-terms-generator
+    dpkg -l "taler-merchant*" "libtalermerchant" 2>/dev/null | awk "/^ii/{print \$2,\$3}"
+  '
+  pod_root "$MERCHANT_CTR" '
+    set -e
+    # schema: prefer tools as service user; failures may be noisy — check /config after
+    if id taler-merchant-httpd >/dev/null 2>&1; then
+      runuser -u taler-merchant-httpd -- taler-merchant-dbinit 2>&1 | tail -20 || true
+    fi
+    runuser -u taler-merchant-httpd -- /usr/local/bin/start_merchant.sh --restart
+  '
+}
+
+smoke() {
+  echo "======== smoke (host loopback) ========"
+  curl -sS -m 8 -o /dev/null -w "bank    %{http_code}  :9012/config\n" http://127.0.0.1:9012/config || true
+  curl -sS -m 8 -o /dev/null -w "exchange %{http_code}  :9011/config\n" http://127.0.0.1:9011/config || true
+  curl -skS -m 8 -o /dev/null -w "merchant %{http_code}  :9010/config\n" https://127.0.0.1:9010/config || true
+}
+
+case "$only" in
+  all)
+    upgrade_bank
+    upgrade_exchange
+    upgrade_merchant
+    smoke
+    ;;
+  bank) upgrade_bank; smoke ;;
+  exchange) upgrade_exchange; smoke ;;
+  merchant) upgrade_merchant; smoke ;;
+  -h|--help|help)
+    sed -n '2,20p' "$0"
+    exit 0
+    ;;
+  *)
+    echo "usage: $0 [all|bank|exchange|merchant]" >&2
+    exit 2
+    ;;
+esac
+
+echo "DONE — re-run taler-monitoring versions/urls from a laptop if desired."