BlockTrades RocksDB proposal to Steemit

2년 전

Steem nodes are costly to operate and the cost is increasing

The Steem blockchain currently requires significant resources to run a Steem node for acting as a Steem witness or for operating a cryptocurrency exchange. For example, if you want to run a witness that runs on an average cloud server, you can expect to need 47GB currently, and this is likely to increase beyond 64GB before too long. This latter value is important because server costs increase dramatically as a server exceeds certain memory requirements (64GB, 128GB, 256GB, 512GB). These memory costs also impose limits on the ability for the Steem network to grow in terms of users, posts, comments, etc, so it’s important to Steem’s future to reduce the costs of running a Steem node.

Replacing chainbase storage with rocksdb storage to slash node operating costs

BlockTrades believes the most suitable solution to this problem is moving much of the blockchain state data that is currently stored in a database called “chainbase” into a more efficiently organized form using the RocksDB database. Chainbase was an early attempt to reduce the memory requirements of running a Steem node, but it ultimately failed because the storage mechanism was poorly tuned for storing data on a hard disk, which lead to most nodes storing their chainbase in a form of “RAM disk” in order to operate at acceptable performance levels. In other words, node operators found that the data still needed to be stored in memory in order for the node to operate acceptably.

Unlike chainbase, RocksDB is specifically designed for efficient storage and retrieval of data using standard hard disk technology, so it will enable this state data to be moved out of memory once and for all, resulting in reduced costs to run Steem nodes.

Why BlockTrades is the natural candidate to implement rocksdb in Steem

The BlockTrades development team has long been concerned about the increasing costs of running Steem nodes and we approached Steemit over a year ago with a design architecture for using Rocksdb to solve the problem, based on our prior experience with high performance database coding. Steemit was generally receptive to the idea and we implemented an initial proof-of-concept under contract with Steemit that stored database from the “account history plugin” that carried one of the highest memory costs for the API nodes operated by Steemit. This technology was successfully deployed in Steemit’s production servers and has allowed Steemit API servers to continue operating on high end cloud servers.

Note, however, that this was just a proof-of-concept to show that Rocksdb met the performance requirments to allow state data to be moved from memory to disk storage by writing special case code to move the account history data. It did not reduce the memory requirements of the “consensus” state data that requires witnesses to run nodes with a large amount of memory. But we proposed a second stage project whereby we would develop a generic way to move Steem state data (stored in C++ data structures called multi-indexes) on to disk storage using Rocksbd, then use this technology to move most if not all of the state data onto disk.

An important part of this latter proposal was to also develop an extensive test framework to verify that functional operation and performance of the Steem node was not degraded as we progressively move more and more of the state data onto disk storage. At the time, Steemit rejected that proposal as they decided that enough memory optimization had been done for their immediate needs and Steemit planned to move all the non-consensus data out of the nodes into a separate database (variously SBDS and Hivemind).

If hivemind is going to reduce memory costs, why is rocksdb needed?

Hivemind will move “non-consensus” state data out of the API nodes operated by Steemit that are used to serve data to steemit.com and other web sites and user interfaces like busy.org, steempeak, partico, appics, etc. But it won’t reduce the amount of memory required to operate the most important nodes required to keep Steem a decentralized network: witness nodes. Rocksdb, however, will allow this data to be moved to disk, allowing witness to operate nodes at reasonable cost now and in the future as the blockchain’s activity level increases.

Why re-propose this now?

Steemit has recently expressed a renewed interest in reducing the costs of operating Steem nodes. At the same time, they’ve reduced the number of employees able to complete various Steem-related projects. We at BlockTrades believe that we can provide the expertise to complete the Rocksdb at an efficient cost and free up Steemit’s blockchain programmers to focus on other high priority tasks like implementation of SMTs.

What are we proposing?

Our proposal is to analyze the key data structures currently consuming memory in consensus nodes (i.e. witness nodes) and then move some of this data into Rocksdb storage using a generic solution we will develop. We will then thoroughly test the resulting version of the node versus the operation of existing chainbase nodes to ensure that the replacement will be seamless. The generic solution we develop can then be used to move more state data out to disk as required in the future and the regression test system we develop will be re-usable as well. We believe we can perform this work in 2-3 months with a 6 person team for a fixed-cost of $250K.

If this is an offer to Steemit, isn’t this better done directly to Steemit?

We have approached Steemit with this offer and they are considering it, but Ned asked that I also share this information with the whole Steem community and see how the idea is received. I believe this could a great first step to expanding development of Steem’s blockchain code beyond Steem’s core team and will enable Steem to progress faster than ever before, so please let us know in the comments how you view this project proposal.

Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE STEEM!
STEEMKR.COM IS SPONSORED BY
ADVERTISEMENT
Sort Order:  trending
  ·  2년 전

In the era of automated upvotes, my 100% vote for this idea might not be a clear message ;-) but I'm all for this.

Some time ago I was hoping to move to std::allocator, which combined with a deterministic snapshots to save/load state will help a lot in maintenance of steemd nodes. That was before RocksDB, which is now not only a well proven solution, but also opens our way for some more fancy features, and all that without re-inventing the wheel (fast persistent storage).

It will help not only to reduce costs of API nodes (they will eventually move into steemd + bunch of microservices) but more importantly - consensus nodes.

We really don't want the exchanges to abandon us just because our state (file) is fat and ugly.

2-3 months, however, sounds very risky (I'll be guessing twice as much), especially that it needs to be tested throughly.

·

You would all be very wise to listen to this inhabitant of your planet.

If you need some assistance finding new ways to motivate these people to embrace this proposal, I am willing to lend a hand.

Specifically this one...


·

I think if they work together with Steemit's team, they can speed things up.

·
·

Do you know why Steemit isn't accepting outside help?

"Ned asked that I also share this information with the whole Steem community and see how the idea is received." Everyone seems to think this is positive offer and yet he decided to decline it... Now he's been silent for 16 days after not doing a promised livestream and has been in full power down for quite some time. What's happening?

·
·
·

Nobody knows what's going on in his head 🤷‍♂️

·
·
·
·

Shit, sounds bad. If only we'd had Vitalik with us

·

Evergreen content reduces spam thus reduces ram. The exchanges would abandon Steem because of low trading volume, Ned paid a pretty penny to get listed on binance, did you know that? He paid money. Over 100k, and that pays binance's nodes. Also ned delegated them. It seems the only people trading are the whales trying to dump on each other. Why would I ever invest into a coin the owner of majority (ned) is powering down? Many investors think the way I do.

Sounds good to me. Lets go for it.

  ·  2년 전

I can't for the life of me see a downside to this... It makes absolut perfect sense to me. Not only does @blocktrades already have a dev team that is very familiar with the STEEM ecosystem, but more importantly this frees up Steemit Inc to work on SMTs.

And let's face it, many projects on here were basically betting on that horse to move their initiatives forward. This is the case for appics, actifit, 1up and the list gets quite long.

I sincerely hope this is agreed upon, and that Steemit Inc commits to keeping their initially announced timeline or get as close as possible.

There has been many comments regarding the importance of STMs to restore confidence, which let's face it, without, it's seriously hard to build anything of substance here.

So to me this is not a yes... this is a HELL YES! - let's make this happen, let's get these costs under control, lets move away from depending of Steemit Inc to do absolutely everything.

When the costs become reasonable as to allow us to run a node ourselves (in helpie or with a partnership) - I fully intend to throw our hat in the ring. To me it's never being about the idea of "Oh, but th node doesn't make me money" - I don't care about that, never have... However, I don't want to become homeless while attempting to afford one.

·

I will believe SMT exists once code is open source and we are testing on the testnets. If anyone banked their life or company on words uttered by steemit inc they made a critical flaw. Ned said back in 2017 SMT would be here in jan 2018. Wait. it's not January?

·

Fact is: 250$k is a lot of money. But another fact is: time is money.

2-3 months delay on SMTs is what most stakeholders of Steem are worried about.

By outsourcing the work to blocktrades, Steemit Inc. could get back on track with SMTs and depending on the need, could even release basic SMTs ahead of the scheduled time of May 2019.

Now, with having my limited knowledge in mind of how much Steemit Inc. can afford at this point in time, I'm still very much in favour of this proposal. However, in the end, Steemit Inc. has to make the decision if they believe it's a good investment.

·
·
  ·  2년 전

Fact is: 250$k is a lot of money. But another fact is: time is money.

the simplest yet most realistic way of looking at this... Priority #1 is to restore confidence and that can only be done by trying to meet the already established deadlines.

·
·

I agree with everything except the last part of your comment @therealwolf since I think @ned and @steemit will factor in the support or non-support of the Steem community for this agreement.

·

this frees up Steemit Inc to work on SMTs.

Haven't they learned that SMTs should NOT be the priority for the blockchain?

·
·
  ·  2년 전

Very valid point my friend, however the carrot has been dangled long enough and there is something that I can only describe as "hope fatigue" - Investors, both those in here already and those from the outside looking in have lost a lot of confidence. Delivering on promises is all about restoring that, even if it brings an avalanche of shitcoins, which it very well might.

·
·
·

SMTs will add more pressure and complexity to the system. If the system isn't scalable and optimal, we'll end up with more problems. They should have focused on that before making bold promises. Simply put, we're not ready for SMTs.

·
·
·
·

Part of the issue is that community features are tied up with SMTs, meaning that both the economic AND social feature set of Steem are held back by now launching SMTs. It would be great if somehow we could at least have communities get a chance to take root, even if SMTs take a lot longer. Communities should be a significantly simpler objective to realise.

·

I think it is a huge assumption that SteemIt, Inc. Will go back to working on the SMTs. Just keep in mind that is coming from your sense of priorities and not Ned's.

I love the idea and the proposal. I also know what blocktrades is capable of and have full confidence in their ability to perform.

Question: could part of the cost be offset by the community using its stake to upvote brief daily progress reports?

·

Realistically, I'd probably need to write those reports personally, and giving my own billing rate (much higher than our other programming staff), daily posts would probably end in a net loss, unfortunately. It's also difficult to describe the daily work done by a programming team in a form that is meaningful to non-programmers. I recall this very well, as I had a similar request made when we were working on the BitShares p2p networking layer many years ago (same one used now by Steem code base).

·
·

True.

In any case I have seen comments from several in the community that would be willing to contribute to this much needed solution. With it we all win. Without it............

If necessary I'd prefer to use my stake in order to contribute using whatever method would be the most practical.

I am all for this.

This is really what is needed. Other people outside Steemit to step up and do what needs to be done. I like the idea of your team handling the database conversion to best handle the nodes while lets the Steemit team to continue to focus upon SMTs.

That is a win all around if you truly believe you can pull it off, which I presume you do or you never would have proposed it.

Great idea.

I have more confidence in your team’s development abilities than Ned’s. I would support this proposal.

How are you planning to cover the costs of development? Will this be paid by Blocktrades company funds or are you looking for payment from Steemit, Inc. or other blockchain-related options?

[EDIT] - Just read some of the other comments and found an answer. Will you still go ahead with development if Steemit, Inc. does not accept your proposal? You mentioned that this is a benefit for Steem and node operators, so could development still be possible if they reject the offer?

·

I'm willing to fund the effort in the short term as proposed, if Steemit will agree to some kind of reasonable performance contract, but I don't want to end up in a situation where our guys create code, their guys create competing code, then they just decide to go with their code cause "it's ours, it must be better" (and in any event, it results in a lot of lost programming effort).

If we deliver a product that provides real value to Steem and Steemit, I think it's only fair for Steemit to make a reasonable payment, as they benefit far more than we do. We're actually quoting at below our "normal" rates for fixed-cost blockchain work, as we do have some stake in the results and we hope this can lead to more opportunities in the future.

Some people have also suggested crowdfunding all or a portion of the work costs, but I think the expense and time overhead make that option less attractive in this particular case. That said, I do think it would make sense in the long run for Steem to have some kind of worker proposal system like BitShares has. It's been very successful, IMO.

·
·

Nice to finally see some action with my own eyes.. Yes yes yes make this happen!

Also, I don't know how not to get behind the idea of a worker proposal system like Bitshares. It has worked for them, it has worked for Dash, it will work for Steem, Power to the community.

Posted using Partiko Android

·
·

"I do think it would make sense in the long run for Steem to have some kind of worker proposal system like BitShares has. It's been very successful, IMO."

This!

  ·  2년 전

good solution by ned scott

I fully suport the idea.
Steemit Inc can't do everything.
I would love to see the experts try to estimate time and effort to analyze if the 250k is a fair price for that work.
From my point of view if it is paid after the work is done it is worth to accept it.

Nice proposal @blocktrades
Really appreciated.

I have read all the comment and made me a picture.

BlockTrades has my voice to do it

This is a win win for Steemians and it creates room for investors

Any initiative that makes witnesses more affordable (ie not requiring potential memory pools of 128GB+ with scalability) is an excellent proposal. This will allow more competition in the witness game, and further increase decentralisation.

It would motivate someone like myself to invest in physical hardware, and then co-locate it in a data centre, instead of the current trend of people hosting servers on leased equipment, which is ultimately not "their property".

It feels as though having all of these "decentralised" witness servers (many of which are physically located or hosted by the same providers) - presents a risk to the blockchain - what if that server provider was shut down?

I'd love to see more witnesses / full nodes in locations that are not data centres for these very reasons:

  1. Increased decentralisation
  2. Increased competition = witnesses that do stuff for STEEM
  3. The concept of custody and ownership makes people care about things a lot more
·

that is why we at @swisswitness have our own machine located in a data center safely in the Swiss mountains... no cloud, no leasing
its a little bit more work to set it all up but was worth it in our opinion for all the reasons stated above. It helps with the whole decentralisation and as such makes steem more secure as a blockchain.
I know you have your 30 votes spent but if there is ever one that is freed up we would appreciate the vote.

·
·

Gave you the vote.

·
·
·

I have not seen it on the list maybe something went wrong. Here is the easy steemconnect link.
thanks for wanting to though :-)
https://steemconnect.com/sign/account-witness-proxy?proxy=swisswitness&approve=1

·
·
·
·

Check my steemworld.org and you'll see I did it

Posted using Partiko Android

·
·
·
·
·

yea, its weird, i usually use https://steemian.info/witnesses to check and it was not there but I can see it on steemworld and on steemd.
thanks for the vote, its really appreciated

This would be fucking incredible! Here's hoping it turns into a thing!

This solution sounds to be significantly better than purely relying on the previously presented concept of modularising the node software to facilitate clusters of servers that operate as a single server (allowing for increased levels of raw processing power - but with greater overall hardware cost).

I imagine the quoted cost would be more than covered by less than a year's operating with the more efficient system and the associated lower hardware running costs. I have no idea of the state of Steemit Inc's 'bank account' - but one way or another the community can afford this.#

It should also be highlighted that @blocktrades has stated that if Steemit inc. doesn't accept the finished result then they don't pay.

·

Good point about reducing cost versus spreading the load over multiple servers via the modular blockchain idea. The modular idea has it's place, but the low hanging fruit should be gathered first.

·
·

Absolutely, yes!

·
·

I approve this message, and proposal.

Thanks for outlining the proposal. A store developed, hardened and proven is better than rolling their own.

  1. Do you expect that there will be significant in-RAM data that can be moved into the storage?
  2. Do you think there might be space savings to be had by reducing duplication of objects in the store? It appears that between the consensus data and the data needed by the APIs there is the potential for a lot of unnecessary duplication.
  3. RAM storage is typically treated as synchronous to access, RocksDB would be async. Do you think that will add risky complexity to your proposed solution?
    Finally,
  4. Would @blocktrades be open to a performance-based contract? ie most of the payment made for acheiving a specified maximum RAM usage at a certain lookup performance on a certain CPU / RAM / storage config?
·
  1. Yes, pretty much all blockchain state data is currently stored in-RAM (with the exception of account history for nodes already running with the rocksdb version of that plugin). So long term we can expect the RAM requirements to drop to a very small amount, since most of the data is stored in those multi-indexes.
  2. Good question, we actually did look into that a while back and saw some oportunities for moderate gains from reducing duplication. But those gains only really become attractive after we first attack the "elephant in the room" that currently dominates in terms of RAM costs (chainbase itself).
  3. Yes, and our architecture includes a caching design to address such issues. But obviously we have to still deal with cache misses, and this is why we've placed such an emphasis on developing a rigorous testing system to catch problems that could result.
  4. We would, but first we need to get the multi-index usage data from Steemit (it exists, but our team no longer has access to it) so that we can figure out a reasonable plan for what things we could most safely move out of memory and for what benefit. If Steemit give the nod to this idea, we can get that data, make a quick estimate on the memory savings, then write the contract terms based on that.
·
·

Thanks. You have my full support.

·
·
  1. Would @blocktrades be open to a performance-based contract? ie most of the payment made for achieving a specified maximum RAM usage at a certain lookup performance on a certain CPU / RAM / storage config?

I think a better payment model would be paying a much smaller amount up front and the balance over time out of the savings achieved. It is in everyone's best interest to not over spend Steem Inc's remaining resources while the token is so low.

I’d also note that these RAM levels correspond to motherboard & chipset limits in the real world.

  • 64Gb is the RAM limit for a regular desktop computer (eg LGA1151 socket);
  • 128Gb is limit for High End Desktop (HEDT) like Intel Skylake X CPUs.

Beyond 128Gb RAM you have to use server motherboards and components which are often much more expensive for small performance improvements.

For true decentralization we need to be in the situation where witnesses can run on regular desktops with 64Gb and full RPC nodes on HEDTs with 128Gb.

Preferably on people’s own hardware as use of cloud services undermines decentralization and creates ongoing operational expenses that can be problematic in times of low Steem prices.

Purchased equipment means you can ride out the tough times. It also proves your commitment.

Posted using Partiko iOS

·

Youre right, the main problem is not beeing able to run a node on a "more regular" machine, as this contributes to more centralization!

·
·

Hell, if I could run a node out of my basement on a decent desktop, I would. Just saying.

·
·
·

Same here, or even on a cheap aws server!

does anyone need some heavy duty onsite equipment? I have connects to one of the largest IT resellers.... Dell HP Lenovo... anything you want... I probably can't sell it to you but I can help you get pricing and connect you with the rep who has your territory

While I am extremely supportive of this in concept, I would like to see more details about the work being performed and how the time and cost estimate was calculated. A 6-person team for 2-3 months is a pretty big project and $250k is a significant expense.

I would ask to see a detailed task breakdown of the work to be performed and what exactly each of the 6 people will be doing for those 2-3 months.

·

We could do it for less if it was being done in a way that was risk-free to us (paid by time/labor required rather than a fixed price contract). That's actually the way we do most contracts and I rarely offer a fixed-price contract because of the difficulties of accurately predicting the real costs of software development. I'm giving Steemit a fixed price option in this case so that so that they have a clear upper limit on how much the cost for the work will be. Based on the ROI, I think it's a good offer.

A full breakdown of the actual work isn't really easily recreatable by us until we get more into the task, nor do I think it would be of much interest to most people, as it would very quickly get extremely technical. We have shared such data in the past with Steemit (we don't have access to those documents now, they're owned by Steemit).

·
·

I'm looking at this from the perspective of if I were steemit, inc and I was evaluating this proposal (which I hope that they are). I would just like to see more details is all. You must have done some type of task listing and estimating to come up with the 6 person team size and time frame so I think that would be good to see.

Overall I'm excited at the prospect of having your team be involved in development. It was great to meet you at SteemFest and given your large stake in the platform I'm confident that you have the best interests of Steem in mind, which is something that we cannot say about most external developers that we might look at working with.

·
·
·

@yabamatt, for those of us Steemians who don't know who the "I" is speaking for BlockTrades and the corresponding "you" in your response, would you please enlighten us?

Obviously very serious matters, if not the long-term survival of the Steem blockchain, are apparently being discussed, in which case I would hope we can get all "out in the light."

"All cards face up on the table" is another way we might say the same thing here in America.

I appreciate you pressing for details, given all that is at stake (pardon the pun) ... 👍

Posted using Partiko Android

·
·

The fixed price until solution delivery is a ballsy proposal, usually during such projects unforeseen challenges arise. I hope you do not expect to make a lot of profit on the project itself. It could be a great value-driving improvement to the Steem eco-system though.

Is Steemit paying or should we crowd-fund with the community? Maybe 75/25%?

·
·
·

Yes, it's a bit risky, but as long as we can get an acceptable scoping agreement with Steemit, I think its a win-win.

Currently the proposal is for Steemit to pay for it. Crowdfunding is another option, but I don't know how much overhead is involved in going down that path and I hope we can jump start this project quickly.

·

If you look at it purely for paying the staff involved, that comes out to $13,000 per person per month. Not including software licensing, overhead costs (electricity, internet, office space, etc), and that stuff.

Actually, in looking at the responses, a crowd funded option that @fitzgibbon suggests isn't a bad idea. People invested in Steem's success would likely be willing to pitch in...

You have my vote. Your team seems to get things done efficiently.

And this is exactly why I love having voted you guys as my witness. Taking initiative. See a problem, and propose to fix it.

I've don't know much about running a witness server, or anything in general and would like some things clarified, and hopefully that helps others out too.

  1. Is the 47 GB thats needed SSD storage or RAM?
  2. You stated that the work could be completed for about $250k. Do you have an estimated amount saved for STEEMIT INC.?
  3. Would STEEMIT INC. be paying that $250k? After laying off 70% of their staff, do you think they would be willing to do that?

Again, thanks for being awesome and supporting STEEM out in multiple ways. This is what I hope to see from more witnesses.

·

Great questions...

  1. In practice, it's RAM. We tend to run our Steem nodes on 64GB RAM virtual machines.
  2. I'd prefer not to make estimates for them, but I'm confident they would rapidly get their ROI (within less than a year).
  3. Yes, Steemit Inc would be paying the $250K (at least under my proposal). And they can easily afford it, IMO. The layoffs were done to reduce their enormous burn rate, not because they were facing anything like imminent bankruptcy. Steemit is in a strong financial position right now, IMO.
·
·

Thanks for the response. And the savings would be shared by the witnesses too right(due to lower server requirements)?

·
·
·

Yes, it would allow witnesses to run cheaper nodes now and even more importantly, in the future, as Steem blockchain activity levels increase.

·
·

Great price IMO!

·

Is the 47 GB thats needed SSD storage or RAM?

Currently the shared data area for a witness node is about 47 GB however the data area doesn't all need to be in RAM. It seems 32 GB is enough RAM to run a witness node with state data swapped from SSD by the OS and even less is possible (I've successfully tested as low as 4 GB, though that was a while ago). Low memory configurations carry a severe performance penalty and operational challenges and may become entirely unworkable should the network traffic increase.

A well designed and production quality database (which chainbase is not) is generally designed to get better performance with less RAM.

·
·

Agree with all of the above, naturally. But the performance penalty for operating in such a mode is too high IMO and will get progressively worse with time, based on current trends.

·
·
·

32 GB is not that bad still. My seed works with 32 GB with only a modest penalty. 4 GB is of course extreme penalty. I don't suggest anyone do that for production, and I only did it to see if it were possible. It was possible but not practical.

And of course RAM usage will continue to grow, although the budgets allowed by RC result in a fairly modest growth rate. That's a huge improvement where we were pre-HF20, when there was a risk of a rapid RAM blowup. There isn't now.

·
·
·
·

Yes, and as you probably remember, this was my primary reason for being in favor of RC (and also being opposed to previous suggestions prior to the RC hardfork where the witnesses could have increased blocksize to give everyone more bandwidth).

But while we're not currently risking a rapid RAM blowup, the new rules do put limits on how fast the platform can grow, and I believe that a full rocksdb implementation could alleviate this problem to a large degree.

·
·
·
·
·

Agree on that.

·
·
·
·
·

The reward pool is only so large, where is the tipping point on users vs rewards?

With stinc's delegations out the pool is already hit, most newbs are wasting their time.

This wishful thinking of taking fedbook's 100m users is unrealistic.
The math doesn't support it.
We should stop that pie before it gets into the sky, imo.

·
·
·
·
·
·

Steemit was never much like Facebook (the nature of it is entirely different), but other social sites like twitter, reddit, or even youtube are better fits as the sorts of models that Steem/it could seek to emulate.

That aside, I'm not sure what you mean about the reward pool only being so large. That, to me, seems to assume that the price of STEEM is a constant. With more users the theory goes that STEEM would be worth more. Maybe it would, maybe it wouldn't. I don't think you can view the reward pool as a fixed amount that inevitably gets divided up into smaller and smaller pieces with more users though.

I don't personally see anything wrong with engineering the blockchain so that it can support more users and usage and to do so with lower costs. Indeed it seems to be a very good thing.

·
·
·
·
·
·
·

Im with you on spreading access to the bc.
Anyx has put out a how to, but it is out of my league, atp.

I havent fedbooked since they banned me in 2012.
I was on reddit just long enough to sign up here.
This community is much nicer than either of those, imo.

I do recognize the price as a constant in my calculation, it seems more likely than a moon shot, atm, and grok how that might get missed by the less mathed.
Many moving parts to steem.

Im still stuck on a roll back to the n2 with a community, read you and others, enforced cap at 500mv.
I think this makes the math more interesting outside the top 200 daily earners.
Remove all the ninjamined delegations and im sure steem gets interesting then.

A soft cap on investments at 500mv, ~80k usd?, limits speculation and encourages smaller investors.
Instead of needing millions, atm, to be somebody, smaller, more plentiful investors could play.
Limiting losses may entice those that have it to spare.
More could be spread out over multiple accounts without upsetting the curves the way one big account does.
Do we want to remain open to a potential angel, or do we want to appeal to more likely investors?
Stinc seems content waiting for the angels, but if i had 100's of millions of usd, maybe i would, too, but i doubt it, money is nothing to me, i have what i need, personal happiness, its worth more to me, atp.

I dont see the necessary egos grasping what open source entails, atm.
Too attached to what bestows royalty status on themselves.

At some point, tyranny always leads to a coup.
Were it to be a palace coup, and we got listed on the exchanges, we could then let stinc drive their's off a cliff while the new fork potentially thrives.

I would even reccomend leaving the ninjamine stake intact, but with withdrawls locked pending contingencies.

What does steem look like in the market with the ninjamine off the table, a reward curve that rewards popular content, an uber account that antiabuses, and a divorce from the folks that drove us off a cliff over personal hard feelings?

Only the market knows,...

Sounds like a rockin' good plan to make things run smoother for everybody. Thumbs up.

One Word Answer NO.

We don't need to spend more of Steemit Inc's Money, which is essentially all of the stakeholders equity as it takes steem to pay blocktrades to do this. This is sending good money after bad.

What we need is Steemit Inc to focus on blockchain development and sunset steemit.com and all of the nodes and let the apps themselves find a way to run their own nodes in a survival of the fittest environment.

What is proposed here is more centralization which is what scares off a lot of people and investors to buy steem in the first place.

Big no thanks from me.

Btw it's pretty obvious Ned has a problem saying NO, that's why we are in the situation we are in now.

I should add that steemit.com could always be brought back at a future point in time when things are more stable.

Self sufficiency is what we need not cashing out more steem to pay blocktrades which further decreases the price.

·

These changes are necessary to increase decentralization. The RAM requirements for both witness and full nodes are too high and thus make running them too costly for most people.
Getting costs down is crucial for true decentralization as I’ve detailed here: https://steemit.com/steem/@apshamilton/decentralisation-of-full-nodes-essential-for-steem-s-success
If Blocktrades can do this and it lets Steemit Inc focus on core blockchain development I’m all for it.

Posted using Partiko iOS

·
·

It's a big IF, and costing up to 2.5 million steem isn't a drop in the bucket.

Also how do we know for sure this will work and not create more issues like slowing down the applications?

·

If I understand your argument correctly (and maybe I don't), you seem to be assuming that Steemit won't spend the Steem on anything else if it doesn't fund our proposal. But if so, I have to disagree with this assumption: I have no doubt that over time Steemit will spend its Steem and given past history, the amount we're asking for this contract is a drop in the bucket.

The only question is what it spends it on. It can spend it on internal development of the Steem Blockchain, external blockchain development (i.e. contractors like us), new products of an unknown nature, or Steemit investor payouts. Steemit's internal development team is pretty much maxed out in terms of what it can do now and the only way they could do more would be to re-hire more programmers again, and that's costly and risky (it's difficult to know what you're getting with new hires and it takes a long time to train them to the point they become productive). Also, hiring more internal developers seems much more centralized to me than building up experienced external teams which can take on 3rd party projects in the future.

Maybe it needs emphasis that this work isn't aimed at making steemit.com able to operate more cheaply, although that would certainly be a side-effect. The major goal is to reduce the cost for 3rd party node operators (witnesses, exchanges, and even full API nodes). This is also means that competing 3rd party front-ends won't need to rely on Steemit's API servers to operate (i.e. the network becomes more decentralized). It's a one-time cost that brings down the costs to allow new Steem businesses to compete without leaning on Steemit's infrastructure.

·
·

The 250K is a drop in the bucket thinking is what got Steemit Inc into the position that it's in now. No thanks. Also you're assuming that you're the only one that can do this or that your code is somehow the best. Let businesses create their own nodes, they can prob find a better solution than yours anyway. We need a lean Steemit Inc that respects its cash reserves.

·
·
·

No, it's not the kind of thinking that got Steemit into the position it's in. In point of fact, if Steemit had taken us up on our earlier offer, the work would have already more than paid for itself by now. The failure was in thinking that the ongoing costs weren't that significant (crypto prices were higher and node operational costs probably didn't look so important that they needed to be addressed in the near term). Also they wanted to keep most of their development in-house, despite not being able to hire enough qualified blockchain programmers internally to address the solution themselves.

We're not the only one that can do this. I do believe we can do this more efficiently than any other party out there, in part because we have one of the largest teams of experienced blockchain programmers out there, and we already have a lot of experience with Steem and rocksdb in particular. Also, we already invested a lot of time in working on this solution as part of the proof-of-concept work, which gives us a further advantage. I don't know of any other company that can say the same.

If you think there's some business that can do this right now, other than Steemit or us, I suggest you contact them and see what they say.

·
·
·
·

If steem goes to 10c which is easily possible in this bear market, that 250K would be 2.5 million steem. That is not a drop in the bucket.

Maybe it would have been better maybe not it's in the past. I still think steemit.com is a huge waste of resources, and it would be better to sunset it and make it a wallet, while letting the businesses themselves come up with solutions. Innovation of nodes will def happen a lot faster when steemit stops giving them away for free, because the businesses will be forced to make it profitable themselves. And whichever one succeeds will end up getting the most traffic which means they make the most money.

Just because there isn't a team out there right now that can do it doesn't mean there will be once attention is put to the area.

Btw, experience doesn't matter that much to me. If you look at google, they hire much more based on ability than experience.

·
·
·
·
·

this all seems very pessimistic to me. I would say that the proposal is a good one.
There are a lot of "ifs" in your assumption.

Steem holds about 60 million Steem that is at current prices 20 million dollars. So what "if" that 2.5 million goes to blocktrades? they support the community and are here to make the blockchain better. Its not like they are going to dump it on the market??
If by spending 250k they could reduce the cost of running a witness (there are about 200 witnesses out there not counting the backups) that would be saving a lot of people a lot of money. AND they would save Steemit Inc a lot of running expenses that they claim would be roughly won back in a year. Then why the negativity?
And why would steem need to keep their 60 million Steem?? If they can cut costs and cut spending through this solution its a good one. Plus I would say that @blocktrades would be held accountable by Steemit inc and by the community as a whole if they do not deliver and try to take advantage of the whole situation.

·
·
·
·
·
·

There's a lot more "ifs" in hiring blocktrades than not. It's only a promise and no guarantees. Coding software doesn't always go as planned. I see it like this either

  1. Pay up to 2.5 million steem for a hope

  2. dramatically reduce costs and let the businesses innovate for themselves and focus on what steemit inc does best

I go for option 2. I would never want to put the success of steemit inc or steem itself into the hands of one 3rd party. talk about centralization.

·
·
·
·
·

Steemit.com doesn't waste that much resources, it's the api that pretty much powers nearly the whole ecosystem.

A little skeptical of the performance impact of moving too much consensus data to rocksdb, but it is absolutely worth pursuing it via a cautious methodology that involves selectively moving data and careful regression testing as described in the post. At this point, the transaction performance seems hardly a bottleneck and if and when it becomes one that can be addressed at that point.

Good way to decentralize development and allow more priorities to be pursued at the same time rather than competing for the attention of one team.

Support.

·

I have this same concern. If we can match the performance I’m 100% in but I worry we won’t know until we try it (and it’s a lot of work) and we will find out it isn’t as optimal as the current solution but the current solution has major scaling issues and is forcing us to even more centralization due to costs.

·
·

We have done preliminary tests that made us comfortable with this solution. The account history rocksdb plugin was exactly one such test. We also wrote tests to verify rocksdb performance loading/unloading objects, etc and it left us reasonably comfortable that this approach will work. Of course there's some risk, but we're bearing that burden more than anyone else. If the final results are such that Steemit doesn't want to accept the code, we don't get paid.

·
·
·

I'm really excited to see Follow and Tags in Rocksdb, I'm all for it.

·
·
·

I think that making it more clear that if the end result isn't acceptable, then no fee is paid, will go a long way to getting naysayers behind this.

·
·
·
·

You might be right, but mostly there hasn't been many naysayers, so I thought it was clear enough.

So far as I can recall, it mostly seemed like one guy, and I tried to discuss it with him, but he seemed pretty set on his position so I didn't figure it was worth more effort.

·
·

At least with a match in performance, RocksDB has a rich ecosystem of tools for devs to then start playing around with different schema combos and see what performance can be gained that way. I suspect something might lie in that direction because the nature of storage for a blockchain is different to the storage that better supports API calls (e.g. .getDiscussions('trending', ...))

i have no idea what are you talking about but it sounds good :D
if it is doable, if it will reduce costs, and if you know you can do it, well it needs to be done.

·

no techy either. reduce costs increase revenue. what can i do to help. love this site

Bear in mind conflicts of interest may be occurring here:

Szymon Lapinski Aka Gandalf aka gtg, witness #1 works for http://www.syncad.com

Daniel Notestein aka this posting account and company owner of blocktrades is the founder of http://www.syncad.com

Most of the initial bitshares code is also written by syncad guys

Other folks, all essentially from virginia tech university where dan larimer graduated from and where aggroed once sold math and science software before quitting his job to steal people's card game idea or in the case of the rest, from the same university in poland:

http://www.syncad.com/Services_Site/aboutus.html

http://www.syncad.com/manateam.htm

https://www.sbir.gov/sbirsearch/detail/1466795

http://syncad.com is also found at http://synapticad.com


^ source - http://www.syncad.com/Services_Site/aboutus.html

Perhaps it's only of passing interest that our long time hand selected top witness works for the only bridge exchange 100% embedded into steemit inc since zero day, and that the top witnesses always just agree with steemit, and the hardforks, and never intervene or take direct actions themselves on their budgets and incomes, which is not unsurprising since only about half of them can spell computer, let alone program one, but that judgement is left up to the readers here. This information is only provided to present verifiable facts. Draw your own conclusions.

If this means nothing, than this comment can be ignored.

But I expect too much protesting is about to begin.

Let's hit post here and see what happens.

·

Has it never struck you as strange, that if I'm this shadowy figure you claim, that it's a bit weird that most of the information you're providing links to are web sites owned by me? Or that I've generally operated under my own name in crypto for years before BlockTrades existed as a company (the blocktrades handle really only came into usage after I created the company)?

It's not some strange coincidence that Dan Larimer hired me AND that we're near each other. It's a causal event: Dan was working at an engineering software company in Blacksburg called Phoenix Integration (https://www.phoenix-int.com/). My company, SynaptiCAD, which is also located in Blacksburg got subcontracted to Phoenix to help finish the project Dan was leading, as it was behind schedule. This was the first time Dan and I ever met. We were successful, and Dan was happy with our work.

It was around the same time that this project was in progress that Dan got the idea and then seed funding for BitShares, so he asked me to help with the project on a part time basis after hours (I still had to run my own company). Later he was able to get more funding and was able to subcontract for more guys from my company. In fairness to Dan and the other members of his team, we didn't wrote "most" of BitShares. We wrote the peer-to-peer network layer (it's mostly one big file and it's used in Steem's code too) and we wrote a lot of the original command-line wallet for BitShares (later replaced by separate code when the rest of BitShares blockchain code was rewritten by Dan's team with new operations). We also worked on a separate communication app that never saw the light of day as Dan pulled us off that project to do the p2p code (originally he planned to write that himself).

I don't work with Dan nowadays (we had some philosophical/ethical disagreements), but I've been told he's still more than happy to hire any of our interns that don't stay with us, so I think it says something about the quality of our work.

·
·

Best place to hide things is in plain sight.

And the best way to rob banks, is to keep building them and filling them with customers.

Perhaps placing staff in top management positions and decision making roles isn't a bad idea either.

As for the rest its effectively cut and pasted from links I provided - not new info.

·
·
·

Sorry, I didn't bother to read all the links from my own sites. My point is pretty simple: it's not surprising that people from the same area tend to work together, that's still normal business for most of the world.

What's probably still strange is how many people I work with in different geographies now: Poland, Canada, India, etc.

But are you really surprised that most of the programmers I work with in Poland that you know about are from the same technical university? How many great programming colleges were there in Poland almost 20 years ago when I first started contracting with programmers from there? Most of the initial guys I contracted with there had previously worked at another HDL simulation company (Aldec). They contacted me after they left Aldec, which was hiring cheaper Ukranian programmers (yes, "offshoring" happens even in countries we offshore from) and they knew of us as a company that worked in the same area. I traveled there and interviewed 8 guys, but could only afford to hire some of them at that time.

·
·
·
·

Average people will buy that. Attentive ones with some history here won't.

I've said what I have to say. The rest lies up to whomever passes by here now, to formulate and decide about for themselves as to what conclusions to draw.

Have a wonderful day, Dan.

·
·
·

If this stuff is really of interest, I could make a series of posts on a separate steemit account (I don't want to clog up this one, because we use it for company announcements). Personally I'm not much of a biography/autobiography reader, but I know a lot of people do like them.

·
·
·

Heh, you'd probably be even more shocked how many current and former employees of SynaptiCAD went to Va Tech, the local university. I'm sure it's over 50 people.

·
·
·
·

I noted that in my references above, not citing a specific number.

I'm quite familiar with Blacksburg. My sister is an alumni herself, as are a significant portion of my high school peers from northern Virginia.

Personally, I'm a UVa drop out. I found software more lucrative as an income pursuit in the 80s than pursuing a student loan payment degree.

His offer stands to illuminate relationships and history folks. Vote him up if you are interested.

It still won't tell us much about who operates freedom/pumpkin, but I bet it dances all around that topic all the same without touching on it.

As noted, have a wonderful day Dan. I have no particular plans for my day, and I'm off to enjoy the fact that I don't actually have to have any plans for my days.

·
·
·
·
·

I did a little research myself to try to determine who freedom/pumpkin is, mostly out of curiosity, since I'm reasonably comfortable that he's at least someone from BitShares community (probably someone I know, at least by their handle on that platform, since I don't know many people's "real names" there), but I couldn't figure out much else ultimately, other than the fact that he's technically skilled (for example, he used an encrypted memo fairly early on to send funds to an exchange).

Everyone I've spoken to has denied knowing who he is, so I don't believe he's disclosed his identity to anyone (my assumption that he's male is just that, but it's probably a safe one given the apparent distribution of males/females in earlier bitshares community).

One of our best programmers never finished his degree, so I would never hold that against anyone when it comes to hiring. I hire mostly based on the results of technical interviews.

Have a good one.

·
·
·
·
·
·

You may not know who it is, but I'd say it's a safe bet, it is someone you know quite well. Isn't that ironic.
Lack of a degree never held me back. In my last 3 decades, built and sold a company or two, building another one quite successfully now, and the Fortune 50s, Forbes list billionaires, NASA, SAIC, president clinton and vice gore whom I served during my career, all found me quite adequate for the roles they gave me, even the awards they hung as plaques on my wall during their administration. (Clinton may be a serial killer, but he's a pretty cool dude in person, to be honest, as dude's dudes go.Gore is the tool he appears to be.)

/shrug

This was fun, but it's a good thing you're diversified. Good luck.

·
·
·
·
·
·
·

r/thathappened

·

I'm sorry, but whose card game idea did aggroed steal?

·
·

other than every commercial card game ever, minus mechanics, which most people report steemmonsters doesnt have while you watch it play itself?

as the coder, im pretty sure you already know.

but for passers by, investigate the history of a former user named "spiritualmax". Im not gonna do all your homework for you and the next response to this will be yaba sputtering about how thats bullshit anyway, folks, it's as predictable as rain after you wash your car.

aggroed has never had an original thought and he has done exactly zero of any work most people think he claims as his own. So thats not news to anybody not stuck up his ass doing his work for him or drinking his piss flavored koolaid.

·
·
·

The card game was my idea. I wanted to make a blockchain-based trading card game as soon as I learned about digital assets well over a year ago. It was long before spiritualmax was around, so I certainly didn't steal anything from him. You're saying I stole it from "every commercial card game ever", so by that logic wouldn't every single commercial card game be stolen except the very first one?

The general concept of a card game is not property that can be owned, so thus it is not something that can be stolen. Many games do blatantly copy other successful games that came before them, but we actually tried to make something different and unique. You may think it's worse, which is fair, but that's beside the point.

Overall, your argument here makes no sense and it sounds like you just don't like aggroed so you made something up to badmouth him about which is also completely unrelated to the topic of this thread.

Really I would just like to ask, what's wrong with you? Having differences of opinion is great, and the information you provided regarding the relationships between gtg, blocktrades, dan and ned is all good and important for the community to know. But there's no call for the way you're treating people here.

From the little I know about you, I've seen that you founded a charitable organization, which is great, and seems to show that you care about helping people and making the world a better place, yet the way you are conducting yourself shows the opposite. It's people who don't treat others with kindness and respect that make the world a bad place, so if you want to help, I would start by taking a hard look at how you're treating people yourself.

·
·
·
·

Feel free to do your own research folks. I just bring the facts. Those that deflect them have their reasons to do so.

Cui Bono, kids. Cui Bono.

·
·
·
·
·

Oh but to address your points Yaba?

I don't give a fuck about if you think im nice or not. Sincerely.

But nice gaslighting.

·
·
·
·
·
·

Thank you for making this post and describing your proposal. Ned's post earlier wasn't exactly clear...or perhaps I was just distracted when reading it.

Whether or not your team does this, I think the best thing for the community is for development moving forward to incorporate a more open source community driven mentality. While Steem and Condenser and the majority of other projects involving Steem are open source...they're really rather closed considering. Most open source projects have forums and timelines and such. On Steem, they rarely even talk about the development. There are a TON of developers here. They can help. They could greatly improve Steem and reduce timelines for development. Right now they're just supposed to fork the code and push any changes they have I guess?

If Steem views this as financially beneficial to free their devs from other things, then they should do it. But...I hope if you have any devs with open source experience, that they help get the community involved as well.

I’m guessing that Ned isn’t going to accept this proposal...

https://steemit.com/steemit/@ned/rocksdb-and-smts-announcement

That’s too bad. I was really hoping that a competent dev team would take over some of the development around here. Ned has apparently learned absolutely nothing in 2.5 years. What a waste of money and potential.

·

Yep, they decided they wanted to do it themselves.

·
·

Well, at the very least you sparked a fire that needed to be lit. Thanks.

·
·

Yeah...and they have such a stellar track record of doing things themselves.

When do you think it’ll be time to look for a new blockchain “home?” Doesn’t seem that Ned & Co. are interested in collaborative development...or really any good/useful development. They’re still fixated on SMTs - and a lesser version of the original idea at that - while everything else around them burns.

They’re killing the potential of this blockchain.

·
·
·

I'm glad they passed on BT expensive deal.

·
·
·

It seems selling hopes and dreams is much easier than providing legitimate code. The Smoke Blockchain exists, and they innovated upon what steemit built over 2.5 years. At least with SBD and delegations removed, ram stays low enough the coin economically works in the future. How will new users power up when they know Ned is powering down? This is a fatal flaw. A flaw the witnesses of steem are powerless or too lazy to tackle. How do we encourage investment in, when the "owner" of 70% of the stake powers down? Steemit stagnated on it's innovation. Opening up doors for Smoke blockchain developers and coming dapps to try things like evergreen content. Could Steem even do evergreen? Doubt it. The users would flag it thinking it increases ram, when it actually reduces ram/spam at the same time. Doh.

·
·

That is not good. If cost was issue then that should have been negotiated. But for the sake of decentralised development this proposal should have been accepted to learn and open more into this direction

·
·

Oh well - You gave them a decent offer. With even less staff members do you feel the Steemit team can meet the same timeframe that you proposed?

What do you think of their proposed SMT-Lite solution?

·
·
·

I'm very skeptical on their rocksdb timeline. It looks like an estimate to just to write the code, without assuming adequate time for building a good test framework.

I've privately been advocating starting with SMT-Lite and rolling out more features later, so I'm happy with that change.

I'm not sure what the first couple pages mean. I read it a few times, and yet I'm still pretty confused. Sounds a bit like technobabblejargon. Is the tldr "things are getting more expensive"?
And if so, was this anticipated by those making the decisions?

·

tldr is: Memory requirements are increasing and will increase more as more users join the network and transact there (voting, funds transfers, etc). In order to keep costs under control as the network activity increases, we need to use disk storage instead of memory storage for this data. The rest is details about how to do it.

Yes, it was anticipated that these resource requirements would increase as activity on the blockchain increased. There was already one prior attempt a long time ago to fix this problem called "chainbase", but it didn't really solve the problem very well. Rocksdb is essentially an improved replacement for chainbase.

@blocktrades and @ned,

We need to start thinking strategically and drop the crypto-anarchy ideological dogma. People talk about 'centralization' like it's cancer. No decentralized organization in human history has ever succeeded. Maybe there's a reason. We only need as much decentralization as necessary for security purposes. Beyond that ... practicality needs to pervade.

@ned, STEEM is sitting on $0.30 and is now not even in the Top 50 cryptocurrencies. You've just lost 70% of your troops. It's time to re-structure The Plan.

STEEM/Steemit's 'story' is dying.

I spent 20 years in high finance, most of that running two hedge funds: One, structured finance; the other, currency-trading. Companies need stories and they only come in two versions: Winning or Losing. Feedback loops start occurring, either positive or negative. At the moment, which one would you say is occurring?

The blockchain needs to PROGRESS fast. We need to start experiencing victories. At this point, psychology is MORE IMPORTANT than coding.

If Blocktrades:

  1. Has a viable solution that would materially improve performance;

  2. Is charging a 'fair price;' and

  3. It would allow Steemit Inc. to Focus its Force on enabling projects ... stop debating and just do it.

We're running out of time. Everyday, more people are leaving Steemit. Everyday, Steemit competitors get closer to launch. Morale ... IS NOT good.

On a personal note: There seems to be a willingness amongst many Witnesses and Devs to "Just Let Steemit Die." Let me remind you that there are now more than 2,000 cryptos and the ONLY THING that differentiates STEEM for the others ... is Steemit.

And yet, many seem Hell-bent on engaging in every 'Horizontal Line Extension' (product expansion) imaginable. In the real world (I currently run an advertising agency), companies ONLY EVER attempt this when their 'core product' is secure. Is STEEM's core product, Steemit, secure?

As a further aside, morale could use a boost ... and sometimes a bit of levity does just that:

https://steemit.com/contest/@quillfire/s-b-d-poem-recitation-contest-25-sbd-minimum-comedyopenmic-40

Quill

·

Yes agreed 100%. Decentralization was a nice fantasy, but we need centralization in some aspects, specifically in regards to steemit. Steemit,inc is a private company that needs to operate steemit.com like one if it is ever going to succeed. You guys know better than anyone else excatly what needs to be done to make it sustainable and profitable, now just go get it done and stop wasting time.

·
·

@jrcornel,

A Facebook/YouTube-like social media platform where you get paid to both post and comment ... THAT's the BIG IDEA.

It is utterly brilliant.

But Steemit is not operating, even tangentially, in accordance to the way it was designed to operate. Most notably, there is a MASSIVE disconnect between Compensation and Quality of Content. The critical variable between the two ... Curation ... is all but non-existent. The reason is simple: Approximately 85% of the SP Upvoting Power is in the hands of Whales and Orcas ... which is fine.

What's not fine is that a huge percentage of that is being delegated to bidbots or leased to individual users (and other game-rigging mechanisms) in an attempt to generate 'passive income.'

That scarce and limited upvoting capital needs to be reallocated so that it generates 'Curation Awards.' This is not a matter of individual preference ... the system CANNOT survive without it.

And the ones who need to come to this conclusion are Whales and Orcas. In an effort to generate $100K in passive income, they're destroying the Curation process upon which the entire endeavor is predicated ... and in the process, diminishing their Principal by $1 million.

You can't have it both ways ... you can't kill the Golden Goose and expect it to continue to lay Golden Eggs.

All the other side-projects, they're fine ... BUT ONLY to the extent that they don't diminish the Central Premise of the core product (Steemit), that: Content Shall Be Compensated Commensurate With Its Quality. Absent that, and it's just a matter of time before the entire enterprise disintegrates. I don't know a SINGLE user who is not talking about their 'Plan B' ... everyone has begun to assume STEEM/Steemit's demise and are adapting accordingly. If you assume you will fail, you will.

We MUST change the assumption.

In the below link, I hyperlinked a number of articles (at the end of the post), with proposed common-sense solutions, that I wrote on the subject:

https://steemit.com/contest/@quillfire/s-b-d-poem-recitation-contest-25-sbd-minimum-comedyopenmic-40

There are two additional articles that I promised, but never published. One has to do with a Capital Formation model designed for the realities of STEEM/Steemit (that's primary purpose would be the 'Manufacture of Steemit SuperStar Authors'), and the second, a method of indirectly creating the 'effects of hedging derivatives' so as to protect real-world retailers from the price volatility of the blockchain's cryoto-currencies (including SBD that has failed in this intended role). I have not bothered to publish them as it became clear from the first few articles that nobody (with power) was listening.

The only articles that seem to get attention, despite self-evident evidence to the contrary, is "Ra Ra Ra ... we can't fail ... to the moon, non-sense." Self-reflection and reality-testing are not the strong suits of the ideologically motivated. Perhaps this most recent bloodbath was needed to shock people into reconsidering their mortality.

Quill

·
·
·

Agreed. That has been the age old problem ever since steemit launched. Though I think the focus now is just making sure steemit.com can even survive and be sustainable. Once we get past that we go about fixing what is broken with it.



This may be the greatest idea anyone on your primitive planet has ever had.

You have the full support of The Empire and its vast supply of resources.

Makes a lot of sense, I think. While it seems obvious at first, I'm a little confused about the request for the money, however.

Given that it's an open-source project, where blocktrades stands to benefit greatly from the improvement (both through, hopefully increased steem value, and reduced overhead costs) and is currently already a Top20 witness with a responsibility to maintain or otherwise assist in upgrading the blockchain-- I feel like the appropriate steps would be to gauge sentiment, and then proceed forward regardless of Steemit being onboard or not.

Wouldn't blocktrades benefit from the reduced overhead costs as well? Doesn't blocktrades already benefit substantially by being one of the go-to "Third Party Exchances" linked to directly on Steemit? I seem to recall discussion from numerous parties about how developing the blockchain SHOULD be a core requirement of a witness.

Don't get me wrong -- I think this should almost certainly be the path forward.

This should be done as well as the issue where images and video are stored? As i understand it is stored in some CDN server in the cloud. As a steem witness /node operator i donot want to deal with images or videos .Witness /node operator shall not be liable for content..(nothin happened so far, but with legal framework and its outlook, better be safe than sorry)

·

The actual images and video aren't stored on witness nodes, those are stored on separate servers, so witnesses are definitely not liable for such content.

·
·

This was not the consensus from team members a year ago. They were not sure who would be liable. But since its stored in separate server,its a relief

If I (technical noob) understand correct, this would allow witnesses to run cheaper nodes which would probably lead to more nodes or at least less nodes in danger of being turned off?!

If so, I think this is GREAT idea, especially for this cost.

·

Yes, your understanding of the proposal is correct.

I see a few of the witnesses I vote for answering, so that's good news.
Curious to hear from more.

Is there a plan for a large scale test?
I see you mention thoroughly testing but is it a large scale with real case data?
I seem to recall the lack of test db case on the last HF.... that bit us all.
Particularly hard hit were some who's accounts were smaller, etc. I know the data movement is nothing like the cahge in costs (RC, etc) but still,. without the large test with real world users and data, in a test net, you never know what you don't know

BUT, first pass, I love the concept!

·

Yes, to us thorough testing always means incorporating realworld data when it's possible (and it is in Steem's case). Our team has long been a proponent for more intensive testing of the blockchain code.

·
·

yeah, a SOLID test-net is important
Happy to hear

I think they should work together for good feedback.

that would be great not only for the nodes but also for the blockchain in general, besides that the users need the SMT that is expected to recover the interest of the investors improving the situation of Steem for the next year of which great things are expected in the crypto world

I am not a technical expert on the aspects of data storage and servers but I would say that this idea could signal a critical pivot point where the community and the witnesses that govern the protocol take more ownership to make the ecosystem more sustainable in the future. This is an excellent opportunity as it would be part of an established project that has been able to generate revenues from activities. I hope these ideas are further explored with Steemit to ensure steps are taken to establish a viable business model throughout the ecosystem. Thanks for sharing!

Posted using Partiko iOS

Technicalities are being discussed by competent people but I am all for the proposal for simple reason that it will start decentralizing the development teams. To me that that is most important. 250K is not a big cost to test such initiatives.

This is one of the best proposals I have seen. You have ran a successful POC and the price for a six team project is modest and of course you mentioned a regression test system for further work which I assume will be at least partly automated.

This is a win win for Steemians. Than you for proposing this. I hope it gets taken up.

I don’t have the technical to skills offer up a reasoned Aye or Nay but do recognize several commenters here who I think do have skills indicating Aye. For what it’s worth (0.0001 DOGE at current exchange rates) I wonder though if this runs counter to the idea of a move to more decentralization.

Posted using Partiko iOS

·

One of the key goals of this project is to decrease node costs to the point where it's cheap for anyone to run a node. I believe this will lead to greater decentralization. Currently most if not all of the Steem front-ends rely on Steemit servers, for example. I really feel this has to change.

·

... if this runs counter to the idea of a move to more decentralization.

No. The proposal encourages greater decentralisation. Right now it takes a lot of resources to run a seed node and so very few people do it. Moves, like this proposal, lower the bar for running servers and if the costs reduce enough there will be more public (and private) API nodes. Since API nodes are currently a major point of centralisation, having more will make Steem more decentralised.

I think this it is not an urgent issue to solve for the Steem blockchain although it would be nice to do it.

Rather you should put your experience and resources into solving SMT's.
I have the impression that Steemit Inc is stuck on that and your experienced team would be much more appreciated. It is also a great business opportunity, I'll bet that a lot of dapps teams would be interested into a faster solution even if they have to put more money on the table.

Thanks for the comprehensive post for noobs like me. It seems a good solution for Steemit.inc problems nowadays, so go for it!! :)

Posted using Partiko Android

Oh yes yes yes.

I'm supporting your approach and Steemit Inc should'nt be the only main contributor to steemd project.
And yes, searching solutions to lower infrastructure coast by using better solution is a good practice in IT world

This proposal is exactly what we need right now. Full support!

My steem witness vote for you. <3

I support this project!👏🙌👍😁 ✔🔝💯

Posted using Partiko Android

Chainbase was an early attempt to reduce the memory requirements of running a Steem node, but it ultimately failed because the storage mechanism was poorly tuned for storing data on a hard disk,

I was always curious about the performance of ChainBase as it claimed to similar to LevelDB and other DB engines. So information that you have provided answers some of it. All the best and will look forward to see the benchmarks.

I'm incompetent to comment on programming matters, but I do understand business opportunity and costs. I'm strongly in favor of reducing the expense necessary to implement nodes, as that increases the number of entities that can undertake to do so.

While increasing the number of teams developing on the blockchain is good, for the same reason that increasing the population of nodes is good, I'm too poorly informed as to how this proposal affects that. Mostly folks with specific expertise and skin in the game will have to evaluate this proposal and vote with their wallets, which is appropriate.

I hope this is the beginning of both less expensive and many more nodes, and many more devs working on the blockchain.

Thanks!

How profitable is it to be a witness?

·

Depends on the rank of the witness. We are #73, mine about 8 blocks each day, x by 30 = 240 SP. Latest bill, 310 STEEM.

You have my vote.
While others have suggested solutions, this is the first concrete one (I see) from someone who can actually practically implement it.

I hope Ned goes for it. It would be a confirmation that he actually still cares about Steemit. At Steemfest, sadly, I got the opposite impression.

awesome!

makes to me perfect sense. But i have now a question.

If we have in 2 years 20 times more users / more daps etc. And we get now the problems about the memory/ costs.

How would this work Out? How much more cost efficient can be a new Database Solution?

Because with SMTs i think we need more memory or i am wrong?

reduce costs is for the Network/ witnesses then super important right?

·

SMTs will certainly require more memory if they get market traction, as that will lead to more transactions on the blockchain. So, yes, I think this work is very important to the future success of SMTs and for platform growth in general.

Your site isn't working this morning. It shows that spinner for loading data then errors out 503.

·

I probably should have included @blocktrades in my post.

·

It's back up now.

·
·

Highly rEsteemed!

I support this project!

Huge Support!

Screen Shot 2018-11-25 at 9.06.37 AM.png

Wow @blocktrades just wow.

This proves that @steemit isn't alone in developing the Steem ecosystem. I am in favor of this @ned and look forward to @blocktrades freeing up the @steemit team to work on SMT's.

Thank you!!

Put me down in support of anything that moves us away from total dependence on the people that drove the bus off a cliff.

For what it's worth, I support this proposal. Thank you for the offer.

I'm a hundred percent in favor of this. Good luck and all the best!

Well, I will not pretend to have understood half of what is in this quality post despite my programming knowledge. Clearly I skipped an entire chapter on Databases.
If you are like me, here is a gif of a cat typing code to cheer you up.

·

Thanks for sharing! Such Touch Paw Typing is rarely seen. 😎

·

I just finished a database class for my Masters degree. They taught us that everything is in memory for any respectable organization. This proposal would take us back to slow hard disks.

·
·

I note that the data in most organizations is proprietary, and not distributed amongst witnesses. While disks are not the maximally fastest data storage solutions, they are considerably less expensive. The point to this is that enabling a variety of innovators to participate in Steem is desirable, while corporations have a different use for their data.

I recall that some of the first automobiles ever on American roads were electric cars. Just because something didn't take over the market, or has been done before, doesn't make it obsolete. Steem is competing with certain aspects of financial, media, and other industries, just as electric cars did with Goodyear and Standard Oil.

I reckon it's more important for myriad nodes to be operated than that each node is using top shelf hardware.

Thanks!

it shows up again sometimes it isnt enough to have a talk, you have get in lead to change a thinbgy... maybe this is the stone we needed to get forward again!!

We know something for sure: time IS money. And in the blockchain world even more so.

Steemit could do it themselves, but that hinders our most important objective: SMTs.

I don't know if the change from chainbase to RocksDB will reduce RAM costs so much, but not at a high drop of performance. As I understand, you guys are assuming the risks of the solution being turned down and you not being paid if the performance loss is considerable or for whatever reason.

In my book, STEEM has nothing but to win from this proposal, even if it fails in the end (but hopefully not), because Steemit can refocus on SMTs.

I'm 100% behind it!

If it's partially up to us, then I say: Anything is better than nothing.

And:

$200K sounds better to me than $250K. ;)

·

We could do it for less if we knew we were going to get paid on a time-worked basis rather than a performance basis, because then we wouldn't have any real risk. But whenever we take on the risk of the task taking longer than we estimated and we're getting paid the same fixed amount and even the possible risk of non-payment because of unexpected challenges, we have to charge more to offset that risk.

·
·

After thinking about it more, combined with paying close attention to the reaction of the community (seemingly majority positive), I'd suggest keeping the community informed of progress throughout the procedure, if you're given the go-ahead.

Some seem to be hyped up as if the knight in shining armor has come to save the day. 2-3 months of silence is deafening after the warm and fuzzy feelings wear off. You seem to be quite confident your reputation within this community wouldn't be ruined over this, which is probably a good sign. These folks have been riding the rollercoaster for far too long though; growing attached to new ideas, getting excited, Santa's coming! Then Santa doesn't show up, and the store runs out of pitchforks within a day. I think it would be wise to take the steps required to be able to keep that sort of reaction at bay. If there's a problem, they should know about it, instead of finding out about it, the hard way.

·
·
·

Sounds like a good idea. The best way I can think of to do that would be to report major milestones like implementation of the generic mechanism for moving state data out of memory to disk, then later the memory savings and performance test results as we begin the processing of testing movements of different types of data to disk storage.

The PROs are laid out very succinctly , can you also lay out some of the CONs of the proposal so that a risk/benefit view can be taken for the proposal ?

·

Mostly the cons are to us if we don't deliver a useful solution accepted into the code base. In such a case we don't get paid.

The primary potential con to the wider Steem community in such a case is that Steemit wouldn't be simultaneously working on a similar solution, although this would only be a con if we assume they would succeed where we failed. On the other hand, if the solution turns out not to be workable at all, it becomes a pro to the community again, since Steemit wouldn't waste it's time on an infeasible solution.

Do it! Do it! Do it!

  ·  2년 전

I am 100% for this as well, 250k is a lot but how much is a 2-3 month delay on smts going to cost us ? Plus this solution will pay for itself very quickly with declining costs.

Glad to see you writing this up. Your services are greatly appreciated.

I think this sounds like a good idea.. I don't understand how it works exactly but reducing over head in any business should always be a priority.. especially if you want forward progress. @blocktrades has been around since the beginning I'm assuming but they've always been 100% fair with me. I would expect nothing less with this venture. Good job bringing a solution to the table.

Could this be partially funded by utilizing @fundition ?

https://fundition.io/

That is a very kind and helpful suggestion @blocktrades but since Steemit.inc is on its way to reduce costs and therefore couldn't jold its employees. Why ahould they now spent they last Bucks on your team? I don't mean that it wouldn't be a good decision but its kind of hard to communicate this kind of strategy. If Blockttades does that job couldn't you be compensated with free Ad banners and sponsors links on the Steemit Homepage?

Posted using Partiko Android

i am not having any experience but i just want to be sure that how much total time from now is required to make this task complete and how it will be started? specially how a minnow can support this task like for 250K$ we can make any contribution ! after all we all need to support our platform and steem ! if we support that would be nice as well thanks

Of course yes. This brings us a step closer to decentralized blockchain development and allows Steemit Inc. to keep working on SMTs which so many projects are counting on. I really can't see a downside to this tbh.

This should have been done a long time ago by Steemit Inc. When I was stressing the importance (and urgency) of scalability, they were putting too much effort and emphasis on SMTs, while ignoring the more pressing matters. That's why HF20 was a failure, what's why the UI is still the same 2 years later, that's why the code isn't optimal, and that's why users are still complaining.

If the Blocktrades team can pull it off and deliver, by all means go for it. Also, I still think that SMTs should take the back seat for a while until we have a solid foundation. I suggest Steemit Inc works with your team to speed things up.

This is going backwards, as the rest of the world has already moved almost entirely to RAM storage in the cloud. Don't pay to regress to 90's technology.

·

If all the witness nodes are in the cloud, Amazon wins. For Steem to win the nodes need to be on their hardware. Don't give up Steem to Goldman Sachs.

If you can get it so that I can run a Steem node in my basement on this:

server.JPG

I am completely in favor of this proposal. That would really decentralize this blockchain.

I appreciate the transparency and approve this course of action. What we need next is someone to offer a proposal to develop the Steemit.com frontend, I think quora.com is a likely target market, more so than any other social network type.

Never in all my steemy days have I see a post with so many (deserved) 100% upvotes!

Judging by the responses, it gets my support, especially given the fact that it seems that it's going to pay for itself within a year, and might just enable SMTs to be released on time.

Cheers!

This idea makes so much sense. There is already a dev team in place and @blocktrades already has "skin in the game". The ability to carry it out coupled with huge motivation to make it succeed seems like a no-brainer to me.

I hope there can be some sort of collaboration on this. We definitely need to move forward with development and make it more viable to run the nodes we need. I'd help if I could, but it's not my sort of programming. Make it happen!

My tech knoledge at this point is not enough as I've never worked on such stuff, but as a programmer and steemian I can tell you it sounds quite a nice offer. May be the cost could be traded so both parts are ok with the deal.
I'm as a user and minimal investor hope all this will help solve the costs issues.
Cheers
Pd: thanks so much for keeping an awesome service. What about adding XLM?

This is why I been using your service since day one @blocktrades , you guys definitely give a huge damn about the longevity of Steemit and purposing a very decentralized and mindful option here. I definitely agree with this one, it makes total sense to limit those costs, give ownership to everyone and allow for a more fruitful development to unfold.

Honestly haven't been using Steemit as much as I used to, just not been too beneficial to focus time as much sadly but i still always believe in this community and I would love to see things return to a more even playing field for node owners and bloggers alike.

I truly hope they accept this purposeful idea, and I will resteem this and pass it around, think everyone should debate on this

YES! You guys are clearly able to do this and I’d love to see Steemit Inc continue working on SMT’s in the meanwhile. THANK YOU for this proposal.

Posted using Partiko iOS

Yes, full support. These are the kind of initiatives we need from witnesses to improve the blockchain.

Posted using Partiko Android

As with many people that have already commented and being a witness myself, I'm all for this adjustment and will follow your lead once you've hashed out the specifics. Do keep me informed.

Posted using Partiko Android

@blocktrades seems to know what they're doing and taking some action makes sense. Steemit has definitely had (and still has) its faults, but I can't really put all of the blame on them for where we are. The entire market is down significantly from the new year highs. I think we all knew that at some point there were going to be winners and losers with weak projects getting flushed out.

The proposal isn't without risk, but that's part of the game we're in. Also, if anyone is reading this, can we get rid of the "beta" by the logo? If Steemit is wanting to restore confidence and show progress, get us out of beta. It is what it is. Will beta still be there when SMT's and other changes are implemented?

·

I agree on the "beta" thing, it really makes no sense at this point.

I have more faith in blocktrades than many actors in steemit ecosystem, since bashing people in troubled times accomplishes nothing I will just say this could be a great idea and I shall resteem

I won't pretend that I understand all that is involved but it looks like a win-win solution. Getting control of costs is important regardless of the price of the Steem. We also want to encourage good new witnesses. If high costs are going to be a big barrier then reducing them is essential.

I hope Steemit Inc take you up on your offer; 250k might be a lot but you are bearing all the risks.

Just for the records, lets accept the offer from blocktrades!

Posted using Partiko Android

I’m all for it!

This will allow more users to start witnessing and strengthening the network and more full nodes to be born and support larger traffic.

The no win no fee offer makes it a no brainer.

Posted using Partiko iOS

  ·  2년 전

If this is such a great idea, and everybody here support it, why it hasn't been implemented already?

Congratulations @blocktrades!
Your post was mentioned in the Steem Hit Parade in the following categories:

  • Comments - Ranked 2 with 191 comments
  • Pending payout - Ranked 7 with $ 112,84

I love you guys! One thing you did not mention, but would be very helpful is if you were able to give them time to pay, or accept Steem as a compensation... Perhaps Steem at 1 USD? So 250k Steem?

You're going to do the work, it'll go up, and then what?

I personally trust you and I know how you manage your team. What happens afterwards though? Maintenance, updates, etc will require a long-term commitment and I think everyone would want to see some reassurance that the work done and related expenditure won't go to waste. I also don't know what Steemit Inc devs have been doing or how their time was managed (no, I'm not blaming them) since we're having this discussion now.

I'd like to see some sort of continuity, quantifiable key deliverables/milestones, and advisor-type role set up along with this. You operating as a 3rd party contractor to fill specific gaps is insufficient.

·

We wrote the p2p code on a similar basis and it's operating reliably to this day. When there has been any problems (generally it's mostly been when connecting up new blockchain code to it), we've always been willing to help support finding a fix.

·
·

I understand what you're saying. As I said, I trust you knowing your background. That being said, the p2p code was developed under entirely different conditions, management structure and general workflow environment.

Do you foresee any possible issues, including interpersonal and collaboration, and will the milestones/deliverables be communicated to the community? You already went the route of announcing this project for a buy-in so I'm going to assume yes. One thing I wouldn't want to see is these types of paid projects becoming the norm here.

·
·
·

As a side note, the p2p code was developed very similarly to this proposal (pretty much independently of the blockchain guys). All the management for it was handled on our side. We had a very loose spec (design a p2p system that can handle 10 second block intervals and can provide this simple interface to the blockchain code). Like that task, this change is designed to be "transparent" to most of the existing and future blockchain code itself.

We did meet once a week with the graphene blockchain team, but really that wasn't about the p2p code at all, it was just so that we could contribute ideas to the work they were doing.

·
·
·

Our team previously did some direct collaborative work with Steemit. It didn't go well, IMO, as there was a severe disconnect in management style/culture/process between the two teams (our team had pretty different ideas on all three to the methods used by Steemit). Hence my proposal nowadays is to do the work independently.

I don't think there's any reason to discount paid-for-work projects as long as the tasks are sizeable enough that negotiation overhead doesn't start to get too heavy relative to work costs. It works pretty well for BitShares, IMO.

I announced the project because Ned requested I do so in order to gauge community sentiment. But I don't really know how that will weigh in at the end of the day, and if the proposal is rejected at this point, I think it would have been better to not to make the offer public.

·
·
·
·

You're probably thinking the same thing I'd be thinking if my team was going to do the work. How would you handle a premature termination of the project? Or rejection of the finished code?

BitShares is a much smaller and different. We'll see scamming on an unprecedented level. So far people have only gotten away with delegation misuse, ie. Dlive scammers and the rest. But that's an entirely different discussion so I'll leave it at that.

I think announcing it was a good idea, although a massive headache, after all. Hopefully asking you to post this wasn't Ned's way of rejecting it. Although I'm wondering how many people in comments here are genuinely thinking over this proposal vs how many are replying blindly.

  ·  2년 전

Letting other teams work on solution that could lower the cost of running a node is a good move, since we expect the demand with the launch pf SMT to go higher next year. I support!

In the meantime @steempeak proposes to take over the development of the front end.
... for a fraction of the cost. hahaaha jk

Congratulations @blocktrades! You have completed the following achievement on the Steem blockchain and have been rewarded with new badge(s) :

You got more than 3250 replies. Your next target is to reach 3500 replies.

Click here to view your Board of Honor
If you no longer want to receive notifications, reply to this comment with the word STOP

Do not miss the last post from @steemitboard:

Saint Nicholas challenge for good boys and girls

Support SteemitBoard's project! Vote for its witness and get one more award!

I am all for this, guys!

Anything that will improve steem blockchain I am good with that @blocktrades

Anything that will help Steemit, Inc. downsize while making Witness Nodes more efficient and affordable sounds like a wonderful idea to me.

To have the BlockTrades Team take on this task sounds like a good choice, so as to keep it within the community.

I am not that technical but reading through the proposal and the comments it does make sense to me.

Having Steemit Inc spend 250k for something that will pay itself back to the company in about a year and on top of that reduce the costs of running witnesses I cannot see a lot of drawback there. (being a witness myself with @swisswitness we appreciate any cost reduction)
Plus it allows Steemit Inc to keep their team lean and focus on the blockchain and SMT side.
I believe that the 60 million steem that is in that war chest is perfect for things like that.