Updates on steem-python, SteemData, and the node situation
steem·@furion·
0.000 HBDUpdates on steem-python, SteemData, and the node situation
## steem-python Users of the [Python Steem library](https://github.com/Netherdrake/steem-python) should upgrade to `0.18.93` as soon as possible. This version comes with new fixes, one of which prevents undefined behavior when all steemd nodes fail. It will now throw a `SteemdNoResponse` exception after exhausting automated failover and all of 200 retries (10 node failovers, 20 retries per node). ## SteemData I have been receiving a fair amount of complaints about [SteemData](https://steemdata.com) state falling behind. There are two ways to remedy this issue: 1.) Write a high performance http -> websocket proxy [1], as well as perform internal state reconstruction to avoid querying steemd. 2.) Deploy a dedicated, self-healing steemd cluster. Needless to say, both solutions are time and resource intensive, and unfortunately, I am not abundant in either right now. Big thanks to @gtg for letting me use his personal steemd node(s), which, when online, keep SteemData in sync. ## Call for help Full rpc [2] steemd nodes are a challenge to run. Currently, they require expensive servers with 128GB of RAM, and regular baby-sitting. To my knowledge, there are no open solutions for managing steemd clusters . As rpc nodes became harder and more expensive to run, community powered nodes disappeared. Aside from @gtg's node, I am not aware of any public nodes. *As far as I know, two of the best community developers, @jesta and @good-karma run their own.* Steemit's nodes are generally a bit slow, and occasionally unreliable [3]. If we'd like the Steem ecosystem to support third party apps and developers, we need better infrastructure. We need to create a node cluster that is: - worldwide distributed, with geo-location based load balancing - scalable, openly monitored, and self-healing (trough automated remediation workflows) - capable of running on all servers, and not locked down to a single vendor like AWS **There many talented people in our community, and I hope we can tackle this challenge.**  [1] Steemit is already working on one, [jussi](http://github.com/steemit/jussi) [2] Nodes with all plugins/api's enabled, serving at high throughput. [3] Based on my experience with extended usage of their nodes for SteemData and Witness Tools.
👍 furion, tb0t89, eval, inchonbitcoin, anwarabdullah, kyusho, ebook-wizard, jackstep, prateek547, seymourbucks, trendo, van14, anubisthegaylord, mkt, beeskee, rizaldamti, samanthabonin, melip, steemrollin, ajvest, viralcutz, eutectico, chasmic-cosm, gringalicious, stackin, pula78, will-zewe, nyanlynn, larrydavid4, zeidlitwhips, jackkang, sc-steemit, steevc, steemtruth, stevenomole, weetreebonsai, steemlinks, ullikume, anotheranna, exec, youngkim, ethansteem, helene, xiaohui, parimple, lingfei, aomura, mark-waser, digital-wisdom, jwaser, herpetologyguy, devilwsy, davidjkelley, ethical-ai, bwaser, ellepdub, morgan.waser, handyman, strong-ai, technoprogressiv, acidyo, roelandp, lalala, jeongwooyu, deanliu, pharesim, idnit, yyyy, xiaokongcom, janiceting, agstakzzz, laoyao, sebastianjago, loreennaa, somebody, aismor, szokerobert, sv67216721, mauricemikkers, bravenewcoin, sneakgeekz, toxic, wongshiying, annieb, steemsports, berlinmoonlight, aggroed, sebhofmann, marxrab, jens84, awesomenyl, beervangeer, chitty, midnightoil, profitgenerator, seaworld, nspart, chinadaily, leomichael, oflyhigh, blackbunny, j3dy, ubg, mericanhomestead, jkkim, cham, ostrich, angelgarz, jamjamfood, sandra, jason, fooblic, riansteem, tommycoin, teamsteem, coinbitgold, dragon40, vandal, chessmasterhex, benderisgreat, greatness96, appledeguzman, cryptofreedom, chosun, capitalpink, greatdabu, misty1z, me-do, pradeep99, xeroc, ihashfury, trafalgar, cryptocrusaders, asmaasema, ecurrencyhodler, osheaaddy, liyan-yan, newprepper, jol09, mrword, daystar, tomshwom, divilati, lukestokes, dududagrav, ethper, redsign, journeyoflife, steemreports, headliner, cristi, thatwilldopig, davidpercival, hashclouds, nirmalprajapati, solar, hag228, alihelal, dominikboecker, gtg, benedicto, whiteliquor, bryan-imhoff, cardboard, themarkymark, saiful83, sheikhfarooq, almost-digital, guiltyparties, personz, neowne, arkaprava, dez1337, parallaxx, cerebralace, ayuwandira, xochicotta, rcmine, bikash-tutor, leesujae17, ejemai, steemitcr, sagebasry, thomasp, tarekadam, anatolich, transisto, kotturinn, barrydutton, fabien, htetlinnaung, patelincho, amarhusin37, runridefly, keppo337, finleyexp, rahmats, joedirt, luigizoloto, iamrifk, ehabakhdar, eddy-ess, arunad, swtcamito, maxbullion, theomwc, alwis, mohamadshwa5, wackou, samether, christoryan, cryptochannel, lenatramper, ebargains, swisswatcher, projectnewbie, adept, rahul.stan, decentralizd, awesomianist, sarasate, hiimamazing, ophelion, erickjongo, besteulz, dber, generation, justaskbigjohn, mantishands, majes, jdbry, johnlue, muhammadalee, norez, geoffrey, lauralemons, lamech-m, greenstar, kemal13, berkah, pnc, hitmeasap, someguy123, kenny-crane, steem-id, albertogm, mondeja, garvofe, enriqueig, phenom, cmorton, nulliusinverba, sportsprediction, sstefan, rossco99, letc, ninkhisibir, pheonike, michaelx, fatboy, gomeravibz, dan-bn, blakemiles84, theshell, raymondspeaks, brendio, libertyteeth, jamhuery, varunempire, enki, lukestokes.mhth, hilarski, robertosanha, cybertiger, skynyc, samuelpaddy, avelee, etcbits, khristinyork, muji, argutatio, robrobbes, luceafarul, alexpmorris, theflood, the-alien, abasinkanga, taspingo, positivitysteem, nyakpo, ensee, dothers, imthestan, zalb, yourhelper, thedashguy, mrfoot, angels, daveks, digit, viktorija, saadmmirza, cropwhip, sellergenius, dmacshady, pvelazquez4, anu, midnas-howler, sethlinson, allyouneedtoknow, belleontherocks, paolonews, ghoost, cristian-mesa, pir8aye, jaysonmarishe, palme, fauzipase, jstein101, azrielmuhammad, formcrypto, deividas, donchate, cryptopanda, davidalexander, christ2169, holdilocks, ace108, scicey, ciscocz, auroralyrayoga, vladislavr, younes04, gladiator4war, muhammadfarid212, lsc9999, isolet, gregario, breezin, geetharao, hasib-shuvo, gabriel1992, lastiger, bilal7, charless, darylg, cosmo.crator, juniorfelicio, dikki, dhabal, fuzzigog, jugalz, bigpay, amitkumar05512, khanhtrinh, coocoocachoo, youknow212012, sameerkumar, vphda, fahter25, kirkduchesne, droider98, davidbrogan, bdmel, siddm96, ausbitbank, aarkay, heidi-dream, anjiba, money-locks97, matrix69, ryanarcher, chicosonico, duekie, arsar, spidersprog, supersnooper221, hr1, xxrobxx, rizkiavonna, antonchanning, benjojo, qsypoq, eturnerx, skripi76, mada, jwebber, deepaktrade, bikash1993, xeldal, followbtcnews, shellyduncan, drwom, andreanoronha, attilaloe, bukharisulaiman, maxse, shiera, junvebbei, parth-r, slavix, mohamedahmedsala, eleon88, bohmano, roykattoussi, pollux.one, sky77, geofftk, adil7222, padmakshi, najib05, andreenkodn, aklahassane, d-man, hooda1artist, clodoweg, kwonjs77, endtimenews, kalijakov, maulianda, ahmadzaki, soviazulka, artoraly, theeashman, actionman, sealixer, zlacee, semasping, benniebanana, hodlor, alejcs, judasp, slava7450745, tommyquest, evgenya86, sk828man, vladimir11, hereforawhile, michieldsp, oussamasoujaa, jhonione, andrew-jesus, roma.tlekhutch, t3ran13, dmilash, stellabelle, nadhora, qed, maite, aaronaugustine, deimus, anthonyadavisii, mykeura, nicolaepavelean, ikenna, inversor, radicalbradical, viswasekar, burstbubble, countzero, c-c-c, dedyirwanda, britcoins, teodorescu, dan-atstarlite, luisneira, sminchow, dvdspelert, sustainarchist, mynameisbrian, daniel007, harrywill, abdulguffer, chantha, shihabieee, cass, safran, siniceku, aurealistic, hightouch, dwinblood, justyy, jithin, spiral27, qmist, manikanta, bertimusx, denkomanceski, techtek, aymen2227, bikalsiwakoti, fauzi03, mohdmohsin, fernandorivera, makingcashads, anonsurf,