!pzUvZuELuIHOeZCGJO:matrix.org

CF Trash Talk

10 Members
Shit talk other people's clusters, but be nice to the humans (you assholes). 1 Servers

Load older messages


Timestamp Message
21 Feb 2019
04:39:11@danielle.wis:matrix.orgdanielle.wislol
04:39:22@danielle.wis:matrix.orgdanielle.wiswhile putting their actual recycling in the bin
04:39:28@danielle.wis:matrix.orgdanielle.wisbecause they care about the environment
04:39:30@danielle.wis:matrix.orgdanielle.wisjust not my cluster
04:39:33@di0_thedestroyer:matrix.orgdi0_thedestroyerwell people aren't monsters, dan
04:39:36@danielle.wis:matrix.orgdanielle.wishave you thought about stream-processing solutions?
04:39:50@di0_thedestroyer:matrix.orgdi0_thedestroyerlike with spark again
04:39:55@danielle.wis:matrix.orgdanielle.wisnah
04:40:21@danielle.wis:matrix.orgdanielle.wishttp://clusterfights.com/wiki/index.php?title=Project_Gutenberg_MD5_Search#Trivial_Solution
04:40:25@danielle.wis:matrix.orgdanielle.wislike check out this python solution
04:40:43@danielle.wis:matrix.orgdanielle.wislike how you use awk, grep, sed, etc
04:40:54@danielle.wis:matrix.orgdanielle.wisassume that there is no input but stream input
04:40:58@danielle.wis:matrix.orgdanielle.wisand there is no output but stream output
04:41:07@danielle.wis:matrix.orgdanielle.wisno printf, just STDOUT
04:41:12@danielle.wis:matrix.orgdanielle.wisno readline, just STDIN
04:41:32@danielle.wis:matrix.orgdanielle.wisthere are probably wrappers that treat C sockets like file handles
04:41:48@danielle.wis:matrix.orgdanielle.wisi think you can just use them that way actually
04:42:19@danielle.wis:matrix.orgdanielle.wisthe code is like 7 lines long for a stream processor
04:42:31@danielle.wis:matrix.orgdanielle.wisand i can use it to process all the files
04:42:39@danielle.wis:matrix.orgdanielle.wis$ find u/ -iname "*.txt" -exec cat {} \; | python gutenhash_streamer.py c29c193a59d27ed00448b204579a0874 8
04:42:48@danielle.wis:matrix.orgdanielle.wisor if youre lazy like me
04:42:57@danielle.wis:matrix.orgdanielle.wis$ find u/ | grep txt$ | xargs cat | find u/ -iname "*.txt" -exec cat {} \; | python gutenhash_streamer.py c29c193a59d27ed00448b204579a0874 8
04:43:45@danielle.wis:matrix.orgdanielle.wistreat the gutenhash solution like grep, but instead of doing $ cat somefile | grep substring you do $ cat somefile | gutengrep c29c193a59d27ed00448b204579a0874 8
04:43:55@danielle.wis:matrix.orgdanielle.wisit makes it suuuper composable
11:58:00@gnarlsmarley:matrix.orggnarlsmarley joined the room.
18:21:08@bobsmith-dpi:matrix.orgbobsmith-dpi joined the room.
18:28:15@brandonb:matrix.orgbrandonb joined the room.
23 Feb 2019
04:06:46@jeff_comstockisthebest:matrix.orgjeff_comstockisthebest joined the room.
9 Mar 2019
05:30:00@swedishhat:matrix.orgswedishhat changed their profile picture.
10 Mar 2019
17:57:41@lrvick:matrix.orglrvick joined the room.

There are no newer messages yet.


Back to Room List