| 30 Mar 2021 |
 hexmode | ok, you convinced me. I will. | 21:51:35 |
 Jeffrey Wang (MyWikis) | Lol, my silence was very convincing | 21:52:01 |
| hexmode | I confess, I talked myself into this whole thing as a way to avoid some other stuff I should really be doing | 21:52:42 |
| hexmode | and, to defend my honor, of course. | 21:52:53 |
| hexmode | but since this is code I'm giving to $CLIENTS, I can justify some of the time. | 21:54:41 |
| 31 Mar 2021 |
| hexmode | updated with some stats and a comparision with my old server: https://pastebin.com/XKTSJRXW | 00:45:07 |
| hexmode | I think one thing that really slows down the old server is quota checking on the fs, but I'm not sure right now | 00:45:36 |
| Jeffrey Wang (MyWikis) | is sorting included in this benchmark? | 02:30:17 |
| hexmode | there is sorting in the function being measured (scroll down to line 83), so, yes, sorting time is included. | 16:32:35 |
| hexmode | updated https://pastebin.com/XKTSJRXW a bit with another benchmark and a few more stats. My takeaway: If you are on a 4.x linux kernel with extfs4, keep the number of files in the directory under 10,000. If you go above 100,000 files in a directory, it will slow way down. | 19:22:15 |
| hexmode | If you have to have 100,000 files in a directory on ext4, use a newer kernel. | 19:22:57 |
| hexmode | Now to compare run time to a single php file with the same statements (so, remove the listing of files, sorting of files, and reading of files) to see how much time this all adds to the who process. | 19:24:27 |
| Jeffrey Wang (MyWikis) | I'd be interested in seeing how each of the components do timewise | 20:21:04 |
| hexmode | updated https://pastebin.com/XKTSJRXW a final time with new script and stats comparing a 1 file with X number of echo statements to X number of files with 1 echo statement. Where X=100, multiple files are about 22x slower. Where X=100,000, multiple files are about 136x slower (on new kernels). | 20:24:00 |
| hexmode | What do you mean "each component"? | 20:24:41 |
| Jeffrey Wang (MyWikis) | How much time sorting takes vs how much time reading takes | 20:24:57 |
| Jeffrey Wang (MyWikis) | I haven't tried regressing these data into a function yet, but I'd have to assume O(n log n) applies here | 20:25:43 |
| hexmode | Sorting is happening all in memory and reading is going to disk. Sorting is going to be faster. Further, PHP uses quicksort, which is fast. | 20:30:11 |
| hexmode | but you've thrown another distraction gauntlet down. I'm not picking it up right now. | 20:30:42 |
| Jeffrey Wang (MyWikis) | No worries, appreciate all of the work you've done so far | 20:31:05 |
| 14 Apr 2021 |
 @dataspects:matrix.org | Recent developments inspired by yesterday's discussion between Cindy, Jeffrey, Bryan (thanks again 😀 to all of you) and myself:
- The container-internal LocalSettings.php now contains:
$mwmls = "../mwmLocalSettings.php";
# MWStake MediaWiki Manager
if(file_exists($mwmls)) {
require_once($mwmls);
} else {
echo "ERROR: ../mwmLocalSettings.php include not loaded.";
}
- The installer creates a volumed-in
mwm.sqlite database.
- When enabling/disabling an extension,
mwm.sqlite is updated (https://github.com/dataspects/mediawiki-manager/blob/main/cli/lib/addToMWMSQLite.php and https://github.com/dataspects/mediawiki-manager/blob/main/cli/lib/removeFromMWMSQLite.php).
- Upon each update of
mwm.sqlite, mwmLocalSettings.php is recompiled by https://github.com/dataspects/mediawiki-manager/blob/main/cli/lib/updateMWMLocalSettings.php.
These redesigns are preliminary steps to address the 3 main issues identified during yesterday's talk:
- Avoid regexing seds
- Move functionality from bash-only into higher-level language
- Avoid editing of LocalSettings.php
Developing...
| 15:36:42 |
| 22 Apr 2021 |
|  lionalext joined the room. | 15:59:45 |
| 27 Apr 2021 |
| Jeffrey Wang (MyWikis) set a profile picture. | 22:45:09 |
| 4 May 2021 |
 cicalese | dataspects: Take a look at Adam Shoreland's new blog post about WBStack on Kubernetes: https://addshore.com/2021/04/wbstack-infrastructure-2021/. | 14:28:31 |
| @dataspects:matrix.org | This looks promising... 👍️ | 15:53:31 |
| 7 May 2021 |
| Jeffrey Wang (MyWikis) | here's Lex's new repo for the CLI portion of MWM: https://github.com/dataspects/mediawiki-cli | 17:34:12 |
| 11 May 2021 |
 addshore | Hi all!
Just found this channel, sounds like we could have some interesting conversations :) | 16:25:04 |
| cicalese | Hah! I was just looking for this to find the comment above directing dataspects to your blog post, addshore . Glad to see you made it here first! | 17:00:09 |
| 12 May 2021 |
| @dataspects:matrix.org | Hi addshore , great to see you here! I'm currently 100% taken on another project, but we should converse at the next MWStake meeting... 👍️ | 13:16:39 |
| 25 Jun 2021 |
|  rundg changed their display name from freephile to rundg. | 16:35:40 |
