release 1.13.7: optional and meta scripts under meta/

Move deprecated mail/mattermost host-agent units, firecuda outside-runner helpers, and legacy multi-host site-gen into meta/. Production stays host-agent + site-gen/console_to_html.py; install no longer ships mail/mm timers.
2026-07-19 03:36:12 +02:00 · 2026-07-19 03:36:12 +02:00 · 2a20def806
commit 2a20def806
parent 0c94fb3d2e
20 changed files with 89 additions and 121 deletions
--- a/site-gen/README.md
+++ b/site-gen/README.md
@ -1,83 +1,20 @@
-# monitoring site-gen
+# site-gen — HTML converter + Caddy notes

-Build **console-style HTML** from `taler-monitoring` runs and stage them for
-**host Caddy** (`/monitoring`, `/monitoring_err`).
+**Required for host-agent:** `console_to_html.py` (log → sticky HTML).

-Same **global reporting defaults** as host-agents (`run-host-report.sh`):
-
- **`RUN_TIMEOUT=600`** on each suite run  
- **line-buffered** logs (continuous write)  
- **always** write HTML (first run / empty logs too)  
- Forgejo **commit link** in the page header  
-
-Applies to all nine fronts (GOA + FP stage + FP prod) in the default `SITES` list.
-
-| Host | Role |
+| File | Role |
 |------|------|
-| **optional outside runner** (SSH alias via `FIRECUDA_SSH`) | optional runner (public DNS) |
-| **deploy host (`DEPLOY_SSH`)** | deploy staging + Caddy (root service) |
-| **host-agents** | primary: GOA + FP on-box (`../host-agent/`) |
+| `console_to_html.py` | Convert suite console log → public mon HTML |
+| `caddy-monitoring-handles.snippet` | Caddy `handle` / bare redir notes |
+| `ROOT-ON-KOOPA.md` | Publish staging → `/var/www` (paths from env) |
+| `settings.conf.example` | Optional settings for **legacy** multi-host generator |

-No secrets in `settings.conf` — only hosts, paths, site list.
+## Optional / moved

-## Optional outside runner (outside-only) — **disabled for now**
-
-An **optional outside runner** could run public-only monitoring (`SKIP_SSH=1`, phases
-`urls versions`) on a schedule (launchd every 4h) and write HTML under
-`~/var/taler-monitoring-sites-work/html/`. Scripts for that still live here
-(`install-firecuda-timer.sh`, `run-on-firecuda.sh`, plist template).
-
-**Current policy: do not run a real launchd job on the outside runner.**  
-Primary GOA monitoring is **koopa host-agent** (`host-agent/`, user `hernani`,
-local `podman exec`). Re-enable the outside runner only if you explicitly want a second,
-outside-only view.
+Legacy multi-host generate/deploy and firecuda launchd tooling live under
+**`../meta/`** (see `meta/README.md`).

 ```bash
-# optional one-shot (no timer):
-# ssh "$FIRECUDA_SSH"  # e.g. your outside-runner alias
-# ssh "$FIRECUDA_SSH" '~/taler-monitoring-site-gen/site-gen/run-on-firecuda.sh'
-
-# if a timer was installed earlier, ensure it is off:
-# ssh "$FIRECUDA_SSH"  # e.g. your outside-runner alias
-# ssh 'launchctl list | grep taler-monitoring || echo off  # macOS outside runner'
-```
-
-Disabled plists may remain as `*.plist.disabled-*` under `~/Library/LaunchAgents/`.
-
-## Quick start (ops workstation)
-
-```bash
-cd site-gen
-cp settings.conf.example settings.conf   # optional
-chmod +x generate-monitoring-sites.sh deploy-monitoring-sites.sh console_to_html.py
-
-ONLY_HOSTS="bank.hacktivism.ch exchange.hacktivism.ch taler.hacktivism.ch" \
-  SKIP_SSH=1 RUNNER_SSH= \
-  ./generate-monitoring-sites.sh
-
-./deploy-monitoring-sites.sh
-```
-
-Then on koopa **as root**: see **[ROOT-ON-KOOPA.md](./ROOT-ON-KOOPA.md)**.
-
-## URL rules
-
-| Path | When |
-|------|------|
-| `/monitoring_err/` | always: full console log + error list on top (CONTINUE_ON_ERROR run) |
-| `/monitoring/` | **clean** full log if last strict run exit 0; else **stub** linking to `/monitoring_err/` |
-
-Footer links **Forgejo commit** of the **taler-monitoring** suite used for that run.
-
-## Layout
-
-```text
-site-gen/
-  settings.conf.example
-  generate-monitoring-sites.sh
-  deploy-monitoring-sites.sh
-  console_to_html.py
-  caddy-monitoring-handles.snippet
-  ROOT-ON-KOOPA.md
-  README.md
+# normal publish is host-agent on the mon host, not these scripts
+../host-agent/run-hacktivism-monitoring.sh   # etc.
 ```
--- a/site-gen/ROOT-ON-KOOPA.md
+++ b/site-gen/ROOT-ON-KOOPA.md
@ -3,7 +3,7 @@
 Host Caddy runs as **root/systemd** (`caddy` user). Static monitoring HTML is
 **not** put into Taler containers — only host paths + Caddy `handle`.

-After host-agent / `generate-monitoring-sites.sh` + deploy (as hernani), files live in:
+After host-agent (or optional `meta/site-gen-legacy/generate-monitoring-sites.sh`) + deploy, files live in:

 ```text
 $DEPLOY_STAGING (or $HOME/monitoring-sites-staging)/<hostname>/monitoring/index.html
--- a/site-gen/com.hacktivism.taler-monitoring-sites.plist
+++ b/site-gen/com.hacktivism.taler-monitoring-sites.plist
@ -1,34 +0,0 @@
-<?xml version="1.0" encoding="UTF-8"?>
-<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
-<!--
-  launchd user agent — firecuda (max): every 4 hours
-  Install: ./install-firecuda-timer.sh
-->
-<plist version="1.0">
-<dict>
-  <key>Label</key>
-  <string>com.hacktivism.taler-monitoring-sites</string>
-  <key>ProgramArguments</key>
-  <array>
-    <string>/bin/bash</string>
-    <string>__SITE_GEN__/run-on-firecuda.sh</string>
-  </array>
-  <key>StartInterval</key>
-  <integer>14400</integer>
-  <key>RunAtLoad</key>
-  <true/>
-  <key>StandardOutPath</key>
-  <string>__HOME__/Library/Logs/taler-monitoring-sites/launchd.out.log</string>
-  <key>StandardErrorPath</key>
-  <string>__HOME__/Library/Logs/taler-monitoring-sites/launchd.err.log</string>
-  <key>EnvironmentVariables</key>
-  <dict>
-    <key>PATH</key>
-    <string>/opt/homebrew/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin</string>
-    <key>SKIP_SSH</key>
-    <string>1</string>
-    <key>CONTINUE_ON_ERROR</key>
-    <string>1</string>
-  </dict>
-</dict>
-</plist>
--- a/site-gen/deploy-monitoring-sites.sh
+++ b/site-gen/deploy-monitoring-sites.sh
@ -1,44 +0,0 @@
-#!/usr/bin/env bash
-# deploy-monitoring-sites.sh — rsync generated HTML to DEPLOY_WWW_ROOT on koopa.
-# Does NOT reload Caddy (needs root — see ROOT-ON-KOOPA.md).
-set -uo pipefail
-
-ROOT=$(cd "$(dirname "$0")" && pwd)
-SETTINGS="${SITE_GEN_SETTINGS:-$ROOT/settings.conf}"
-[ -f "$SETTINGS" ] || SETTINGS="$ROOT/settings.conf.example"
-# shellcheck disable=SC1090
-set -a
-source <(grep -v '^\s*#' "$SETTINGS" | grep -v '^\s*$' | sed 's/\r$//')
-set +a
-
-WORK_ROOT="${WORK_ROOT:-/tmp/taler-monitoring-sites-work}"
-HTML_DIR="$WORK_ROOT/html"
-DEPLOY_SSH="${DEPLOY_SSH:-}"
-DEPLOY_WWW_ROOT="${DEPLOY_WWW_ROOT:-}"
-
-if [ ! -d "$HTML_DIR" ]; then
-  echo "no HTML_DIR $HTML_DIR — run generate-monitoring-sites.sh first" >&2
-  exit 1
-fi
-
-echo "deploy $HTML_DIR → ${DEPLOY_SSH}:${DEPLOY_WWW_ROOT}/"
-# Prefer writing to a hernani-owned staging dir if /var/www not writable
-STAGE_REMOTE="${DEPLOY_STAGING:-${DEPLOY_STAGING:-$HOME/monitoring-sites-staging}}"
-
-ssh -o BatchMode=yes -o ConnectTimeout=20 "$DEPLOY_SSH" \
-  "mkdir -p '$STAGE_REMOTE' '$DEPLOY_WWW_ROOT' 2>/dev/null || mkdir -p '$STAGE_REMOTE'"
-
-rsync -az --delete "$HTML_DIR/" "${DEPLOY_SSH}:${STAGE_REMOTE}/"
-echo "staged on $DEPLOY_SSH:$STAGE_REMOTE"
-echo
-echo "If $DEPLOY_WWW_ROOT is root-owned, as root on koopa:"
-echo "  mkdir -p $DEPLOY_WWW_ROOT"
-echo "  rsync -a --delete $STAGE_REMOTE/ $DEPLOY_WWW_ROOT/"
-echo "  chown -R caddy:caddy $DEPLOY_WWW_ROOT   # or root:caddy — match other www"
-echo "  # then Caddyfile handles + reload — see ROOT-ON-KOOPA.md"
-echo
-# try direct rsync to DEPLOY_WWW_ROOT if writable
-if ssh -o BatchMode=yes "$DEPLOY_SSH" "test -w '$DEPLOY_WWW_ROOT' 2>/dev/null || test -w \"\$(dirname '$DEPLOY_WWW_ROOT')\""; then
-  rsync -az --delete "$HTML_DIR/" "${DEPLOY_SSH}:${DEPLOY_WWW_ROOT}/" && \
-    echo "also synced directly to $DEPLOY_WWW_ROOT"
-fi
--- a/site-gen/generate-monitoring-sites.sh
+++ b/site-gen/generate-monitoring-sites.sh
@ -1,273 +0,0 @@
-#!/usr/bin/env bash
-# generate-monitoring-sites.sh — run taler-monitoring, build console HTML for
-# /monitoring and /monitoring_err (static files for host Caddy later).
-#
-# Usage:
-#   ./generate-monitoring-sites.sh              # all SITES (or ONLY_HOSTS)
-#   ONLY_HOSTS="bank.hacktivism.ch taler.hacktivism.ch" ./generate-monitoring-sites.sh
-#   ./generate-monitoring-sites.sh --dry-run    # HTML from empty/missing logs only
-#   ./generate-monitoring-sites.sh --skip-run   # only convert existing logs
-#
-# Settings: settings.conf (from settings.conf.example). No secrets in settings.
-# Secrets for e2e: ../secrets.env (optional; default phases are urls versions).
-#
-set -uo pipefail
-
-export PYTHONUNBUFFERED=1
-# Global reporting defaults (same as host-agent run-host-report.sh)
-: "${RUN_TIMEOUT:=600}"
-export RUN_TIMEOUT
-
-ROOT=$(cd "$(dirname "$0")" && pwd)
-SETTINGS="${SITE_GEN_SETTINGS:-$ROOT/settings.conf}"
-EXAMPLE="$ROOT/settings.conf.example"
-
-if [ ! -f "$SETTINGS" ]; then
-  if [ -f "$EXAMPLE" ]; then
-    echo "note: no $SETTINGS — using example defaults (copy to settings.conf to customize)"
-    SETTINGS="$EXAMPLE"
-  else
-    echo "missing settings: $EXAMPLE" >&2
-    exit 2
-  fi
-fi
-
-# Load KEY=value lines; allow SITES already set in environment to win.
-# Multiline SITES in the conf file: use SITES_FILE= or env SITES= instead.
-while IFS= read -r _line || [ -n "$_line" ]; do
-  _line=${_line%%#*}
-  _line=$(echo "$_line" | sed 's/^[[:space:]]*//;s/[[:space:]]*$//')
-  [ -z "$_line" ] && continue
-  case "$_line" in
-    SITES=*|SITES_FILE=*) continue ;; # handled below / env
-    *=*)
-      _k=${_line%%=*}
-      _v=${_line#*=}
-      # do not override pre-set env
-      if [ -z "${!_k+x}" ] 2>/dev/null || [ -z "${!_k}" ]; then
-        export "$_k=$_v"
-      fi
-      ;;
-  esac
-done < "$SETTINGS"
-
-# SITES from dedicated file or keep env; else parse heredoc-style from example list
-if [ -n "${SITES_FILE:-}" ] && [ -f "$SITES_FILE" ]; then
-  SITES=$(grep -v '^\s*#' "$SITES_FILE" | grep -v '^\s*$')
-  export SITES
-elif [ -z "${SITES:-}" ]; then
-  # default 9 fronts
-  SITES="bank.hacktivism.ch|hacktivism.ch
-exchange.hacktivism.ch|hacktivism.ch
-taler.hacktivism.ch|hacktivism.ch
-stage.bank.lefrancpaysan.ch|stage.lefrancpaysan.ch
-stage.exchange.lefrancpaysan.ch|stage.lefrancpaysan.ch
-stage.monnaie.lefrancpaysan.ch|stage.lefrancpaysan.ch
-bank.lefrancpaysan.ch|lefrancpaysan.ch
-exchange.lefrancpaysan.ch|lefrancpaysan.ch
-monnaie.lefrancpaysan.ch|lefrancpaysan.ch"
-  export SITES
-fi
-
-SKIP_RUN=0
-DRY=0
-while [ $# -gt 0 ]; do
-  case "$1" in
-    --skip-run) SKIP_RUN=1; shift ;;
-    --dry-run) DRY=1; SKIP_RUN=1; shift ;;
-    -h|--help) sed -n '1,20p' "$0"; exit 0 ;;
-    *) echo "unknown arg: $1" >&2; exit 2 ;;
-  esac
-done
-
-MONITORING_ROOT=$(cd "$ROOT/${MONITORING_ROOT:-..}" && pwd)
-WORK_ROOT="${WORK_ROOT:-/tmp/taler-monitoring-sites-work}"
-LOG_DIR="$WORK_ROOT/logs"
-HTML_DIR="$WORK_ROOT/html"
-mkdir -p "$LOG_DIR" "$HTML_DIR"
-
-# commit of monitoring suite used for this run
-if git -C "$MONITORING_ROOT/../.." rev-parse HEAD >/dev/null 2>&1; then
-  REPO_ROOT=$(cd "$MONITORING_ROOT/../.." && pwd)
-elif git -C "$MONITORING_ROOT" rev-parse HEAD >/dev/null 2>&1; then
-  REPO_ROOT=$(cd "$MONITORING_ROOT" && pwd)
-else
-  REPO_ROOT=$(cd "$ROOT/../../.." && pwd)
-fi
-COMMIT=$(git -C "$REPO_ROOT" rev-parse HEAD 2>/dev/null || echo unknown)
-COMMIT_SHORT=$(git -C "$REPO_ROOT" rev-parse --short=12 HEAD 2>/dev/null || echo unknown)
-SOURCE_REPO_WEB="${SOURCE_REPO_WEB:-https://git.hacktivism.ch/hernani/taler-monitoring}"
-TMPL="${SOURCE_COMMIT_URL_TMPL:-\{repo\}/src/commit/\{commit\}}"
-COMMIT_URL=$(printf '%s' "$TMPL" | sed "s|{repo}|$SOURCE_REPO_WEB|g; s|{commit}|$COMMIT|g")
-SUITE_PATH="${SOURCE_SUITE_PATH:-.}"
-
-# Outside-only public checks (no SSH into koopa/stage containers)
-PHASES_ERR="${PHASES_ERR:-urls versions}"
-PHASES_OK="${PHASES_OK:-urls versions}"
-CONTINUE_ON_ERROR="${CONTINUE_ON_ERROR:-1}"
-SKIP_SSH="${SKIP_SSH:-1}"
-# Drop SSH phases if someone passes "all" / inside / server / e2e by mistake
-filter_phases_outside() {
-  local out=() p
-  for p in "$@"; do
-    case "$p" in
-      inside|server|e2e|ladder|goa-ladder|auth401) continue ;;
-      all) out+=(urls versions);;
-      *) out+=("$p") ;;
-    esac
-  done
-  printf '%s\n' "${out[@]}"
-}
-
-run_mon() {
-  local domain="$1" phases="$2" logfile="$3" cont="$4"
-  # shellcheck disable=SC2206
-  local ph=( $phases )
-  mapfile -t ph < <(filter_phases_outside "${ph[@]}")
-  [ "${#ph[@]}" -gt 0 ] || ph=(urls versions)
-
-  : >"$logfile"
-  echo "+ -d $domain · phases=${ph[*]} · CONTINUE=$cont · SKIP_SSH=$SKIP_SSH · RUN_TIMEOUT=$RUN_TIMEOUT"
-
-  if [ -n "${RUNNER_SSH:-}" ]; then
-    echo "+ via ssh $RUNNER_SSH"
-    rsync -az --delete \
-      --exclude secrets.env \
-      --exclude 'android-test/artifacts' \
-      --exclude '.git' \
-      "$MONITORING_ROOT/" \
-      "${RUNNER_SSH}:${RUNNER_REMOTE_WORKDIR}/" \
-      || return 1
-    # shellcheck disable=SC2029
-    if command -v stdbuf >/dev/null 2>&1; then
-      ssh -o BatchMode=yes -o ConnectTimeout=30 "$RUNNER_SSH" \
-        "cd '${RUNNER_REMOTE_WORKDIR}' && chmod +x taler-monitoring.sh check_*.sh 2>/dev/null; \
-         export CONTINUE_ON_ERROR='$cont' AUTH401_CONTINUE='$cont' SKIP_SSH='$SKIP_SSH' RUN_TIMEOUT='$RUN_TIMEOUT'; \
-         stdbuf -oL -eL ./taler-monitoring.sh -d '$domain' ${ph[*]}" \
-        2>&1 | stdbuf -oL -eL tee -a "$logfile"
-    else
-      ssh -o BatchMode=yes -o ConnectTimeout=30 "$RUNNER_SSH" \
-        "cd '${RUNNER_REMOTE_WORKDIR}' && chmod +x taler-monitoring.sh check_*.sh 2>/dev/null; \
-         export CONTINUE_ON_ERROR='$cont' AUTH401_CONTINUE='$cont' SKIP_SSH='$SKIP_SSH' RUN_TIMEOUT='$RUN_TIMEOUT'; \
-         ./taler-monitoring.sh -d '$domain' ${ph[*]}" \
-        2>&1 | tee -a "$logfile"
-    fi
-    return "${PIPESTATUS[0]}"
-  fi
-
-  if command -v stdbuf >/dev/null 2>&1; then
-    ( cd "$MONITORING_ROOT" && \
-        CONTINUE_ON_ERROR="$cont" AUTH401_CONTINUE="$cont" SKIP_SSH="$SKIP_SSH" \
-        RUN_TIMEOUT="$RUN_TIMEOUT" \
-        stdbuf -oL -eL ./taler-monitoring.sh -d "$domain" "${ph[@]}" ) \
-      2>&1 | stdbuf -oL -eL tee -a "$logfile"
-  else
-    ( cd "$MONITORING_ROOT" && \
-        CONTINUE_ON_ERROR="$cont" AUTH401_CONTINUE="$cont" SKIP_SSH="$SKIP_SSH" \
-        RUN_TIMEOUT="$RUN_TIMEOUT" \
-        ./taler-monitoring.sh -d "$domain" "${ph[@]}" ) \
-      2>&1 | tee -a "$logfile"
-  fi
-  return "${PIPESTATUS[0]}"
-}
-
-htmlify() {
-  local host="$1" mode="$2" log="$3" out="$4" other="$5"
-  mkdir -p "$(dirname "$out")"
-  if [ ! -f "$ROOT/console_to_html.py" ]; then
-    echo "WARN: console_to_html.py missing — bootstrap $out"
-    {
-      echo "<!DOCTYPE html><html><head><meta charset=utf-8><title>$host $mode</title></head>"
-      echo "<body><h1>$host · $mode</h1><p>commit <a href=\"$COMMIT_URL\">$COMMIT_SHORT</a></p>"
-      echo "<pre>"
-      tail -n 100 "$log" 2>/dev/null | sed 's/&/\&amp;/g;s/</\&lt;/g' || true
-      echo "</pre></body></html>"
-    } >"$out"
-    return 0
-  fi
-  python3 "$ROOT/console_to_html.py" \
-    --log "$log" \
-    --out "$out" \
-    --hostname "$host" \
-    --mode "$mode" \
-    --commit "$COMMIT" \
-    --commit-url "$COMMIT_URL" \
-    --suite-path "$SUITE_PATH" \
-    --link-other "$other"
-}
-
-# Parse SITES
-mapfile -t SITE_LINES < <(printf '%s\n' "$SITES" | sed '/^\s*$/d' | sed 's/#.*//')
-ONLY="${ONLY_HOSTS:-}"
-
-for line in "${SITE_LINES[@]}"; do
-  line=$(echo "$line" | tr -d ' \t')
-  [ -z "$line" ] && continue
-  host=${line%%|*}
-  domain=${line#*|}
-  if [ -n "$ONLY" ]; then
-    echo " $ONLY " | grep -q " $host " || continue
-  fi
-
-  echo "======== $host  (domain=$domain)  commit=$COMMIT_SHORT ========"
-  base_html="$HTML_DIR/$host"
-  mkdir -p "$base_html/monitoring" "$base_html/monitoring_err"
-  log_err="$LOG_DIR/${host}.err.log"
-  log_ok="$LOG_DIR/${host}.ok.log"
-  ec_err=1
-  ec_ok=1
-
-  if [ "$SKIP_RUN" != "1" ]; then
-    run_mon "$domain" "$PHASES_ERR" "$log_err" "$CONTINUE_ON_ERROR"
-    ec_err=$?
-    # ok-run without continue (strict)
-    run_mon "$domain" "$PHASES_OK" "$log_ok" "0"
-    ec_ok=$?
-  else
-    [ -f "$log_err" ] || : >"$log_err"
-    [ -f "$log_ok" ] || : >"$log_ok"
-    # infer exit from log if present
-    if grep -q '\[ ERROR \]' "$log_err" 2>/dev/null || grep -q 'ERROR' "$log_err" 2>/dev/null; then
-      ec_err=1
-    else
-      ec_err=0
-    fi
-    ec_ok=$ec_err
-  fi
-
-  # Always write pages (first run / empty logs too)
-  [ -f "$log_err" ] || : >"$log_err"
-  [ -f "$log_ok" ] || : >"$log_ok"
-
-  htmlify "$host" "err" "$log_err" \
-    "$base_html/monitoring_err/index.html" "/monitoring/"
-
-  if [ "$ec_ok" -eq 0 ] && [ "$ec_err" -eq 0 ]; then
-    htmlify "$host" "ok" "$log_ok" \
-      "$base_html/monitoring/index.html" "/monitoring_err/"
-    echo "  → /monitoring (clean) + /monitoring_err"
-  else
-    htmlify "$host" "redirect" "$log_err" \
-      "$base_html/monitoring/index.html" "/monitoring_err/"
-    echo "  → /monitoring (redirect stub) + /monitoring_err (errors)  ec_err=$ec_err ec_ok=$ec_ok"
-  fi
-
-  # first-run safety
-  if [ ! -f "$base_html/monitoring/index.html" ]; then
-    htmlify "$host" "err" "$log_err" \
-      "$base_html/monitoring/index.html" "/monitoring_err/"
-  fi
-
-  printf '%s\n' "$COMMIT" >"$base_html/COMMIT"
-  printf '%s\n' "$COMMIT_URL" >"$base_html/COMMIT_URL"
-  printf 'host=%s domain=%s ec_err=%s ec_ok=%s commit=%s run_timeout=%s\n' \
-    "$host" "$domain" "$ec_err" "$ec_ok" "$COMMIT" "$RUN_TIMEOUT" | tee "$base_html/STATUS.txt"
-done
-
-echo
-echo "HTML under $HTML_DIR"
-echo "commit $COMMIT_SHORT  $COMMIT_URL"
-echo "RUN_TIMEOUT=${RUN_TIMEOUT}s (global; 0=unlimited)"
-echo "Deploy (as hernani, may need sudo for /var/www):"
-echo "  ./deploy-monitoring-sites.sh"
-echo "Root on koopa: see ROOT-ON-KOOPA.md"
--- a/site-gen/install-firecuda-timer.sh
+++ b/site-gen/install-firecuda-timer.sh
@ -1,83 +0,0 @@
-#!/usr/bin/env bash
-# install-firecuda-timer.sh — OPTIONAL: rsync suite to firecuda + launchd every 4h
-#
-# POLICY (2026-07): firecuda launchd is **disabled**. Prefer koopa host-agent.
-# This script remains for documentation / future re-enable only.
-# Do not run unless you intentionally want a second outside-only scheduler.
-#
-#   ./install-firecuda-timer.sh
-#   ./install-firecuda-timer.sh --run-now
-#
-set -euo pipefail
-
-ROOT=$(cd "$(dirname "$0")" && pwd)
-MON_ROOT=$(cd "$ROOT/.." && pwd)
-FIRECUDA="${FIRECUDA_SSH:-}"
-if [ -z "$FIRECUDA" ]; then
-  echo "Set FIRECUDA_SSH to your outside-runner SSH host alias" >&2
-  exit 2
-fi
-REMOTE_BASE="${FIRECUDA_INSTALL_DIR:-taler-monitoring-site-gen}"
-RUN_NOW=0
-[ "${1:-}" = "--run-now" ] && RUN_NOW=1
-
-echo "install → $FIRECUDA:~/$REMOTE_BASE (outside-only, every 4h)"
-
-ssh -o BatchMode=yes -o ConnectTimeout=20 "$FIRECUDA" \
-  "mkdir -p \"\$HOME/$REMOTE_BASE\" \"\$HOME/Library/Logs/taler-monitoring-sites\" \"\$HOME/var/taler-monitoring-sites-work\" \"\$HOME/Library/LaunchAgents\""
-
-# Sync full taler-monitoring suite (no secrets.env)
-rsync -az --delete \
-  --exclude secrets.env \
-  --exclude 'android-test/artifacts' \
-  --exclude '.git' \
-  --exclude 'site-gen/settings.conf' \
-  "$MON_ROOT/" \
-  "${FIRECUDA}:$REMOTE_BASE/"
-
-# settings on firecuda: outside only, run locally on firecuda, deploy to koopa
-ssh -o BatchMode=yes "$FIRECUDA" "cat > \"\$HOME/$REMOTE_BASE/site-gen/settings.conf\" <<'EOF'
-# auto-installed by install-firecuda-timer.sh — no secrets
-RUNNER_SSH=
-SKIP_SSH=1
-CONTINUE_ON_ERROR=1
-PHASES_ERR=urls versions
-PHASES_OK=urls versions
-DEPLOY_SSH=${DEPLOY_SSH:-}
-DEPLOY_STAGING=${DEPLOY_STAGING:-$HOME/monitoring-sites-staging}
-WORK_ROOT=
-MONITORING_ROOT=..
-SOURCE_REPO_WEB=https://git.hacktivism.ch/hernani/taler-monitoring
-SOURCE_COMMIT_URL_TMPL={repo}/src/commit/{commit}
-SOURCE_SUITE_PATH=.
-EOF
-# WORK_ROOT expanded on remote
-sed -i.bak \"s|^WORK_ROOT=.*|WORK_ROOT=\$HOME/var/taler-monitoring-sites-work|\" \"\$HOME/$REMOTE_BASE/site-gen/settings.conf\" 2>/dev/null || \
-  sed -i '' \"s|^WORK_ROOT=.*|WORK_ROOT=\$HOME/var/taler-monitoring-sites-work|\" \"\$HOME/$REMOTE_BASE/site-gen/settings.conf\"
-"
-
-# launchd plist with absolute paths
-ssh -o BatchMode=yes "$FIRECUDA" bash -s <<REMOTE
-set -euo pipefail
-HOME_DIR=\$HOME
-SITE_GEN="\$HOME_DIR/$REMOTE_BASE/site-gen"
-PLIST_SRC="\$SITE_GEN/com.hacktivism.taler-monitoring-sites.plist"
-PLIST_DST="\$HOME_DIR/Library/LaunchAgents/com.hacktivism.taler-monitoring-sites.plist"
-sed -e "s|__SITE_GEN__|\${SITE_GEN}|g" -e "s|__HOME__|\${HOME_DIR}|g" "\$PLIST_SRC" > "\$PLIST_DST"
-chmod +x "\$SITE_GEN"/*.sh "\$SITE_GEN"/console_to_html.py 2>/dev/null || true
-chmod +x "\$SITE_GEN/run-on-firecuda.sh"
-launchctl bootout "gui/\$(id -u)/com.hacktivism.taler-monitoring-sites" 2>/dev/null || true
-launchctl unload "\$PLIST_DST" 2>/dev/null || true
-launchctl bootstrap "gui/\$(id -u)" "\$PLIST_DST" 2>/dev/null || launchctl load "\$PLIST_DST"
-launchctl enable "gui/\$(id -u)/com.hacktivism.taler-monitoring-sites" 2>/dev/null || true
-launchctl print "gui/\$(id -u)/com.hacktivism.taler-monitoring-sites" 2>/dev/null | head -20 || launchctl list | grep taler-monitoring || true
-echo "OK: launchd com.hacktivism.taler-monitoring-sites (StartInterval=14400)"
-REMOTE
-
-if [ "$RUN_NOW" = "1" ]; then
-  echo "run once now…"
-  ssh -o BatchMode=yes "$FIRECUDA" "\"\$HOME/$REMOTE_BASE/site-gen/run-on-firecuda.sh\"" || true
-fi
-
-echo "done. logs: $FIRECUDA:~/Library/Logs/taler-monitoring-sites/"
-echo "manual: ssh $FIRECUDA '~/taler-monitoring-site-gen/site-gen/run-on-firecuda.sh'"
--- a/site-gen/pull-firecuda-to-koopa.sh
+++ b/site-gen/pull-firecuda-to-koopa.sh
@ -1,19 +0,0 @@
-#!/usr/bin/env bash
-# pull-firecuda-to-koopa.sh — copy HTML from firecuda work dir → koopa staging
-# Run on laptop (hernani) where both SSH aliases work.
-set -euo pipefail
-FIRECUDA="${FIRECUDA_SSH:-}"
-if [ -z "$FIRECUDA" ]; then
-  echo "Set FIRECUDA_SSH to your outside-runner SSH host alias" >&2
-  exit 2
-fi
-KOOPA="${DEPLOY_SSH:?set DEPLOY_SSH in env}"
-REMOTE_HTML="${FIRECUDA_HTML:-var/taler-monitoring-sites-work/html/}"
-STAGE="${DEPLOY_STAGING:-${DEPLOY_STAGING:-$HOME/monitoring-sites-staging}}"
-
-echo "firecuda:$REMOTE_HTML → $KOOPA:$STAGE"
-ssh -o BatchMode=yes -o ConnectTimeout=20 "$KOOPA" "mkdir -p '$STAGE'"
-rsync -az --delete \
-  "${FIRECUDA}:${REMOTE_HTML}" \
-  "${KOOPA}:${STAGE}/"
-echo "OK staged. Root: rsync to  (see ROOT-ON-KOOPA.md)"
--- a/site-gen/run-on-firecuda.sh
+++ b/site-gen/run-on-firecuda.sh
@ -1,59 +0,0 @@
-#!/usr/bin/env bash
-# run-on-firecuda.sh — entrypoint for launchd/cron on outside-runner.
-# Outside-only monitoring (SKIP_SSH=1), all 9 sites, then stage HTML to koopa.
-#
-# Installed path on outside-runner (default):
-#   ~/taler-monitoring-site-gen/site-gen/run-on-firecuda.sh
-#
-set -uo pipefail
-
-export PATH="/opt/homebrew/bin:/usr/local/bin:/usr/bin:/bin:${PATH:-}"
-
-ROOT=$(cd "$(dirname "$0")" && pwd)
-LOG_DIR="${FIRECUDA_LOG_DIR:-$HOME/Library/Logs/taler-monitoring-sites}"
-mkdir -p "$LOG_DIR"
-STAMP=$(date +%Y%m%d-%H%M%S)
-LOG="$LOG_DIR/run-${STAMP}.log"
-exec >>"$LOG" 2>&1
-
-echo "======== $(date -Iseconds 2>/dev/null || date) outside-runner monitoring sites ========"
-
-# Always: public DNS only, no SSH checks into stacks
-export SKIP_SSH=1
-export CONTINUE_ON_ERROR=1
-export AUTH401_CONTINUE=1
-export RUNNER_SSH=
-export PHASES_ERR="${PHASES_ERR:-urls versions}"
-export PHASES_OK="${PHASES_OK:-urls versions}"
-export WORK_ROOT="${WORK_ROOT:-$HOME/var/taler-monitoring-sites-work}"
-export MONITORING_ROOT="${MONITORING_ROOT:-$ROOT/..}"
-export DEPLOY_SSH="${DEPLOY_SSH:-}"
-export DEPLOY_STAGING="${DEPLOY_STAGING:-${DEPLOY_STAGING:-$HOME/monitoring-sites-staging}}"
-
-# Prefer full 9-site list from settings or defaults inside generate script
-unset ONLY_HOSTS
-
-cd "$ROOT" || exit 1
-chmod +x generate-monitoring-sites.sh deploy-monitoring-sites.sh console_to_html.py 2>/dev/null || true
-
-./generate-monitoring-sites.sh
-ec=$?
-
-# HTML stays on outside-runner under WORK_ROOT/html.
-# Optional push to koopa if this host can SSH there (often only from laptop):
-if [ -n "${DEPLOY_SSH:-}" ] && [ "${DEPLOY_FROM_FIRECUDA:-0}" = "1" ]; then
-  if [ -x ./deploy-monitoring-sites.sh ]; then
-    ./deploy-monitoring-sites.sh || echo "WARN: deploy staging failed"
-  fi
-else
-  echo "note: HTML at ${WORK_ROOT}/html — pull from laptop:"
-  echo "  rsync -az outside-runner:var/taler-monitoring-sites-work/html/ \\"
-  echo "    $DEPLOY_SSH:monitoring-sites-staging/"
-  echo "  # or: ./pull-firecuda-to-koopa.sh"
-fi
-
-# keep last 20 logs
-ls -1t "$LOG_DIR"/run-*.log 2>/dev/null | tail -n +21 | xargs rm -f 2>/dev/null || true
-
-echo "======== done ec=$ec ========"
-exit "$ec"