In reply to @kasbah:matrix.org
was the darling repo in gitea not up to date b4?

In reply to @kasbah:matrix.org
(how come we use docker but stuff still just changes under us?)

In reply to @ghanem__:matrix.org
I cleaned the s3 buckets now to try syncing everything again

In reply to @kasbah:matrix.org
i'm not sure that's the best approach. it's the "turn everything off and on again" solution that gives us less ideas about what's happening

In reply to @ghanem__:matrix.org
We haven't touched the project in six months so it's not that bad 😂

In reply to @ghanem__:matrix.org
I know but I am in the middle of my final exams right now 😬

setting GIT_DISCOVERY_ACROSS_FILESYSTEM reveals the issue is actually postgres:

PostgreSQL Database directory appears to contain a database; Skipping initialization

2024-01-08 06:36:00.649 GMT [1] LOG:  starting PostgreSQL 14.10 (Debian 14.10-1.pgdg120+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
2024-01-08 06:36:00.649 GMT [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
2024-01-08 06:36:00.649 GMT [1] LOG:  listening on IPv6 address "::", port 5432
2024-01-08 06:36:00.654 GMT [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2024-01-08 06:36:00.661 GMT [26] LOG:  database system was shut down at 2024-01-08 06:16:27 GMT
2024-01-08 06:36:00.661 GMT [26] LOG:  invalid primary checkpoint record
2024-01-08 06:36:00.661 GMT [26] PANIC:  could not locate a valid checkpoint record
2024-01-08 06:36:00.795 GMT [1] LOG:  startup process (PID 26) was terminated by signal 6: Aborted
2024-01-08 06:36:00.795 GMT [1] LOG:  aborting startup due to startup process failure
2024-01-08 06:36:00.796 GMT [1] LOG:  database system is shut down

i deleted the gitea/db volumes and now the problem is back to processor:

Error: Command failed: cd /data/checkout/m3cinc/infidel && git pull
fatal: not a git repository (or any of the parent directories): .git

    at ChildProcess.exithandler (node:child_process:402:12)
    at ChildProcess.emit (node:events:513:28)
    at maybeClose (node:internal/child_process:1100:16)
    at Process.ChildProcess._handle.onexit (node:internal/child_process:304:5) {
  code: 128,
  killed: false,
  signal: null,
  cmd: 'cd /data/checkout/m3cinc/infidel && git pull',
  stdout: '',
  stderr: 'fatal: not a git repository (or any of the parent directories): .git\n'
}