Uusi tuutti @matrixdotorg​:​lta:

Megabridges, Synapse cleaning, and a retreat. That and much more happened This Week In Matrix!

https://matrix.org/blog/2024/07/19/this-week-in-matrix-2024-07-19/

In reply to @tdb:tdb.fi
Taas tämmönen hassu kryptattu viesti joka piti lukea Fluffyllä jotta se ilmesty Nhekoon näkyviin. Nää avaimethan menee jotenki clienttien välisinä viesteinä eikä huoneen eventteinä, eikös? Voiko olla et lähettäjän clientti jostain syystä lähettää sen väärälle miun clienteistä?

In reply to @olmari:hacklab.fi
"en tykkää -> rinkirunkku?" 😂

In reply to @jassu:kumma.juttu.asia
Älä huoli… se niiden viestien postaminen tekee jumituksesta todennäköisesti vielä isomman koska sit joutuu käsittelemään sekä ne eventit, että redaction eventit. ;)

In reply to @dataaja95:harrastenurkka.fi
ELi käsitelläänkö jokainen viesti erikseen ja sille vielä oma poistoeventtinsä, kiva kiva

In reply to @olmari:hacklab.fi
Purge empty rooms, find-unreffed-states -tool, compress-state -tool, psql vacuum, full jos tarvitsee kovalevypinnaltakin vapaaksi tilan

In reply to @dataaja95:harrastenurkka.fi
Oliko tuohon find-unreffed statesin suorittamiseen jotain skriptiä, huoneessa taisi joskus pyöriä sellainen

Purge empty rooms

#!/bin/bash

TOKEN=yep
TOPURGE=$(curl -s -X GET --header "Authorization: Bearer $TOKEN" --header "Content-Type: application/json" --data-binary '{}' 'http://localhost:8008/_synapse/admin/v1/rooms?limit=100000'|jq --raw-output '.rooms[] | select(.joined_local_members == 0) | .room_id')

for f in $TOPURGE
do
  echo "Processing $f room..."
  curl -w "\n\nResponse code: %{response_code}\n\n" -s \
    -X DELETE \
    --header "Authorization: Bearer $TOKEN" \
    --header "Content-Type: application/json" \
    --data-binary \
    '{}' \
  'http://localhost:8008/_synapse/admin/v1/rooms/'"$f"''
done
echo "done"

Find unreffed states menee melko lailla käsin GH readme:n mukaan, joku saa toki koodata automaattiseman skriptin..

Compress state olis "moderni" automaattiversio jonka voi ajastaa vaik kerran päiväs tekemään vähän, itte oon ajanu manuaaliversiota koska... oon ajanu...

#!/bin/bash

stty -echoctl # Hide ^C

# User defined variables
ROOM_LIMIT=1000000 # How many rooms to list once, no key for "all", so set it absurdly high
WORK_DIR=tmp
ACCESSTOKEN=also_yep
PSQLADDRESS="postgresql:///synapse?user=matrix-synapse&host=/var/run/postgresql"

sigint_trap () {
    tput setaf 1
    echo "SIGINT caught"
    tput sgr0
    return 2
}

function create_work_dirs () {
  mkdir -p ${WORK_DIR}/new_states || { echo "Failed to create working directories!"; return 1; }
}

function generate_room_list () {
  echo "Generating room list"
  curl --silent \
    --request GET \
    --header "Authorization: Bearer ${ACCESSTOKEN}" \
    --header "Content-Type: application/json" \
  'http://localhost:8008/_synapse/admin/v1/rooms?limit='"${ROOM_LIMIT}"''|jq -r '.rooms[] | .room_id'>${WORK_DIR}/roomlist.txt || { echo "Failed to generate room list!"; return 1; }
}

function compress_rooms () {
  echo "Compressing rooms"
  for ROOM in $(cat ${WORK_DIR}/roomlist.txt)
  do
    echo "Processing room $ROOM"
    ionice -c 3 nice -n 20 ./rust-synapse-compress-state/target/debug/synapse_compress_state -t -c -o ${WORK_DIR}/new_states/${ROOM} -p ${PSQLADDRESS} -r "${ROOM}" || { echo "Failed to compress room $ROOM"; return 1; }
  done
}

function cleanup () {
  echo "Cleaning up"
  rm --recursive --force ${WORK_DIR} || { echo "Failed to clean up working directories!"; return 1; }
}

# Main program
trap 'sigint_trap' SIGINT
create_work_dirs || { cleanup; exit 1;}
generate_room_list || { cleanup; exit 1;}
compress_rooms || { cleanup; exit 1;}
cleanup || exit 1
echo "Finished successfully"

In reply to @olmari:hacklab.fi

Purge empty rooms

#!/bin/bash

TOKEN=yep
TOPURGE=$(curl -s -X GET --header "Authorization: Bearer $TOKEN" --header "Content-Type: application/json" --data-binary '{}' 'http://localhost:8008/_synapse/admin/v1/rooms?limit=100000'|jq --raw-output '.rooms[] | select(.joined_local_members == 0) | .room_id')

for f in $TOPURGE
do
  echo "Processing $f room..."
  curl -w "\n\nResponse code: %{response_code}\n\n" -s \
    -X DELETE \
    --header "Authorization: Bearer $TOKEN" \
    --header "Content-Type: application/json" \
    --data-binary \
    '{}' \
  'http://localhost:8008/_synapse/admin/v1/rooms/'"$f"''
done
echo "done"

Find unreffed states menee melko lailla käsin GH readme:n mukaan, joku saa toki koodata automaattiseman skriptin..

Compress state olis "moderni" automaattiversio jonka voi ajastaa vaik kerran päiväs tekemään vähän, itte oon ajanu manuaaliversiota koska... oon ajanu...

#!/bin/bash

stty -echoctl # Hide ^C

# User defined variables
ROOM_LIMIT=1000000 # How many rooms to list once, no key for "all", so set it absurdly high
WORK_DIR=tmp
ACCESSTOKEN=also_yep
PSQLADDRESS="postgresql:///synapse?user=matrix-synapse&host=/var/run/postgresql"

sigint_trap () {
    tput setaf 1
    echo "SIGINT caught"
    tput sgr0
    return 2
}

function create_work_dirs () {
  mkdir -p ${WORK_DIR}/new_states || { echo "Failed to create working directories!"; return 1; }
}

function generate_room_list () {
  echo "Generating room list"
  curl --silent \
    --request GET \
    --header "Authorization: Bearer ${ACCESSTOKEN}" \
    --header "Content-Type: application/json" \
  'http://localhost:8008/_synapse/admin/v1/rooms?limit='"${ROOM_LIMIT}"''|jq -r '.rooms[] | .room_id'>${WORK_DIR}/roomlist.txt || { echo "Failed to generate room list!"; return 1; }
}

function compress_rooms () {
  echo "Compressing rooms"
  for ROOM in $(cat ${WORK_DIR}/roomlist.txt)
  do
    echo "Processing room $ROOM"
    ionice -c 3 nice -n 20 ./rust-synapse-compress-state/target/debug/synapse_compress_state -t -c -o ${WORK_DIR}/new_states/${ROOM} -p ${PSQLADDRESS} -r "${ROOM}" || { echo "Failed to compress room $ROOM"; return 1; }
  done
}

function cleanup () {
  echo "Cleaning up"
  rm --recursive --force ${WORK_DIR} || { echo "Failed to clean up working directories!"; return 1; }
}

# Main program
trap 'sigint_trap' SIGINT
create_work_dirs || { cleanup; exit 1;}
generate_room_list || { cleanup; exit 1;}
compress_rooms || { cleanup; exit 1;}
cleanup || exit 1
echo "Finished successfully"

New post in Matrix.org: This Week in Matrix 2024-07-26

Uusi tuutti @matrixdotorg​:​lta:

The Matrix Conference programme revealed, Circles going to the community, and bots updates.

That and more happened This Week in Matrix!

https://matrix.org/blog/2024/07/26/this-week-in-matrix-2024-07-26/