!QxIgtJpnMhISnAZHWI:matrix.org

KMD-Scaling-Test

102 Members
21 Servers

Load older messages


SenderMessageTime
17 Jul 2018
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> OK fair point.08:29:39
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> What has been the largest scale test tx/s to date?08:30:05
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> The 1024 chain test.08:30:18
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> but they were 100 pyamnt TX's so the 20,000 number is far lower than theortically possible.08:30:42
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> The 256 chain test, to test kubernetes should eclipse that number easily... theoretical maximum is ~37k tx/s.08:32:27
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> If we need higher than that we can use 512 chains to double it.08:33:12
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> Either size will give us the data we need.08:33:31
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> It's pretty much processing bytes of tx data across a decentralized chain cluster. Correct? 100 chains ~= 200MB/min 1000 chains = ~=2000MB/min 10000 chains = ~=20000MB/min08:50:52
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> https://cdn.discordapp.com/attachments/449949868904022036/468701212317843466/Screen_Shot_2018-07-17_at_6.50.21_pm.png08:51:17
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> I want to build a template/HOWTO so others can take our work and implement their own test.08:51:48
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> Possible now? Or some doc gaps to fill ?08:52:03
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> for a single payment TX.... which is 1 vin to 2 vouts (your payment and the change returned to the first address) you can fit 8859 TX's into a 2MB block. For a 100 payment TX, (1 vin to 101 vouts) you can fit 557 TX into a block. Anything inbwteeen should follow a fixed ratio, you can check this by creating some TX's and seeing how big the raw hex generated is. Each chain can process on average 2MB per minute,09:21:15
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> The transaction size also would work the other way, ie, combining 100 vins to 1 vout, to "join" the UTXO's back together.09:22:17
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> With this data you can do math to work out how many chains is required to achieve any required amount and size of transactions.09:23:29
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> My repo's would need some updating and some more docs for others to start at square 1, with no chains, and generate the JSON with the chain cluster parameters. But its not really that hard, with some updates to my scipts and docs, you can generate any number of chains in a cluster and all required scripts automatically to launch a notary node network to notarize them to KMD.09:26:27
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> It took me about 2H from zero notary network to a network of 4, and min sigs for a notarization of 2.09:27:07
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> In real world, I think min sigs would need to be more than 2 and notary nodes would need to be more than 4, however the compute resource required for these is pretty small. Biggest requirement is RAM.09:28:07
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> In real world, I think min sigs would need to be more than 2 and notary nodes would need to be more than 4, however the compute resource required for these is pretty small. Biggest requirement is RAM and network bandwidth.09:28:17
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> This is great, thanks heaps 🙏 So, with your engineers hat on - in case it wasn't 😛 , a "real world" use case would have multiple vin:vout combos and there'd be many more addresses.09:49:32
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> Yes.09:49:45
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> Which is why I think we should describe it as maximum payments, however even then, the size of the transactions will still vary and the amount of payments in a block will also vary. It totally depends on use case. Designing your cluster to run at capacity is also not clever, likey you would use 50-100% more chains than you 'need'.09:51:20
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> Pretty much bytes processing throughput, with a handful of variables that us clever humans use to measure these concepts as payments and transactions. Noted re: deployment rationale.09:54:48
@komodobridge:matrix.orgkomodobridge[discord] <smk762> Apologies fellas, my nbn is kaput, fault lodged awaiting resolution. Can do a bit via phone but kinda got one hand tied right now.11:59:08
@komodobridge:matrix.orgkomodobridge[discord] <blackjok3r> No worries, we are waiting on kubernetes stuff... AWS decided to make it harder than the google version to use for some reason.11:59:43
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> nsa extensions12:17:28
@komodobridge:matrix.orgkomodobridge[discord] <Mylo(KomodoPioneers)> 12:17:35
18 Jul 2018
@komodobridge:matrix.orgkomodobridge[discord] <smk762> limit of patience exceeded, advised imminent complaint to TIO, and application for compensation due to downtime, and queried remaining contract length in anticipation of alternative provider.09:23:35
@komodobridge:matrix.orgkomodobridge[discord] <smk762> Result = tech will be on site tommorow afternoon 😃09:23:51
@komodobridge:matrix.orgkomodobridge[discord] <smk762> I have my suspicions that connection issues are due to amplified "metadata" retention, and the tech is actually an ASIO spook, but as long as the c*nt sorts out my connection I'll scrub down the filth afterwards09:25:50
@komodobridge:matrix.orgkomodobridge[discord] <smk762> limit of patience exceeded, advised imminent complaint to TIO, application for compensation due to downtime, and queried remaining contract length in anticipation of switching to an alternative provider.09:27:12

Show newer messages


Back to Room ListRoom Version: