Designing A Turning Test For Blockchain Bladerunners

작년


23ea2410329d4bbfab0d63642ecf0e8e_43bd1adbd16707b5ab7b0a0e82dbdcd6_1_original.png

Can a mere mortal create a Turing test that works?


I recently wrote about Idena, the new "proof of person" blockchain project. By running a Turing test on all member nodes at the same time globally, Idena aims to create a uniquely spam free and exceptionally decentralized blockchain. But there are growing pains, one of which involves the model of the Turing test itself.

The original Turing test, which aimed to distinguish artificial from human intelligence, involved a single human tester asking questions of two subjects, one human and one robot. While the goal of Idenas Turing test (Idena calls these tests "flips") is the same, the method is rather different. For starters, it's all done online. Secondly, one requirement of an Idena flip is universal appeal and relevance, so language is not used and rather, questions and answers are both submitted using images only. You can see an example of an Idena Flip below.


bbn.jpg

The user must decide which set of images, left or right, make the most sense in the order they are presented. In the example above, most people would pick the set on the left, as it represents a cohesive narrative. Solving a number of these flips in succession dictates whether or not you are validated on the Idena network. Success or failure is decided by consensus, the idea being that humans will average much higher than AI in these tests.

Essentially, the Idena network is made up of Bladerunners, who test each other regularly, to ensure the system remains bot-free.

A beautifully elegant concept, but not without it's flaws, and these flaws were abundantly evident to me recently during my validation test. Flips are created by all members of the Idena network, and as it expands, it's becoming clear that many people simply are not creating good flips. This has caused some tension in the small Idena community, as people who are clearly human are failing validation tests because of flips which don't make sense.

The reasons behind this are hotly debated. Idena provides a financial incentive to create good flips, and yet, incoherent flips are abundant. Are people too stupid or lazy to create good flips? Or perhaps there has been a failure to educate newcomers on how to create good flips. There has been a push towards educating people on how to make a good flip, including my recent post on the subject, as well as a new "Flip School" section on the Discord server, but I wonder if there is a better way.


4453322.PNG

Frustrated by the volume of "bad flips" on the Idena network, over the last few days, I've conceptualized alternatives and tweaks to the current flip model, and I'd like to present my first proposal here, "Multiple Conclusion". This has been sent to the powers that be at Idena, and I'm awaiting reply.

flip-model-001.jpg

I'm curious to get any thoughts on this model so if you have any feedback or suggestions, please comment below. I'm working on other models at the moment, but so far, this seems to be the strongest candidate.

Thanks for reading.

Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE STEEM!
STEEMKR.COM IS SPONSORED BY
ADVERTISEMENT
Sort Order:  trending

Hello Friend @condra.

This is totally cool!

This model that you have developed seems to me that it can be applied without problems.
In fact, an App for smartphones could easily be developed where people would feel they were playing. The responses would then go to a database to feed an AI that develops new flips.

Thank you for sharing your knowledge and experiences with us.
Keep writing.

Your friend, Juan.

Hello @condra

Thank you for posting within our hive. I upvoted your content already. Please spare few minutes and read how project.hope is organized and learn about our economy.

That would help you understand more our goals and how are we trying to achieve them. Hopefully you will join our community and become strong part of it :)

Do you use telegram or discord? If you do then join our server and give me a shout. I would gladly share with you goals of our community and introduce to others from our team.

Our discord sever: https://discord.gg/F4DUTY

Yours,
@project.hope team,

@condra The block-chain science offers an awfully progressive and secure method of managing transactions online. Hailed as one of the greatest inventions after the web, it has taken the digital world by using storm and is disrupting many industries.

I love the test run you have designed, it is simple for humans to get through successfully, have you tried writing to their support team, they may consider changing those who are not active with their jobs.

·

Thanks. Yes, I was in touch with some of the devs. It seems they have tried a number of models, and the weak point has always been the people designing the tests, more than the test model. Put simply, people are being too lazy to create stories and use images in a way that communicates a cohesive narrative. That's the biggest flaw in Idena right now, members who want to take, without giving anything back.

  ·  작년

In my own opinion, tests like this should not be difficult for human to pass which is the reason for the test in the first place, so in a situation where the test is becoming difficult for humans to pass, the credibility of the workers should be checked.

·

Indeed. This has been a pain point for the Idena project. A lot of people are simply designing bad flips. I spoke with lead developer Andrew about my proposition, and something similar had been tried before. The weak point was not the model of test, but peoples dedication to creating tests that make sense. It's still early days. I'm hoping that over time, the Idena project will be tweaked to allow the cream rise to the top, giving better flip designers more proliferation.

Interesting read @condra

I've noticed that you do not engage with your readers, so I will skip writting any comment since you probably won't read it anyway.

Cheers, Piotr

·

Hahaha can't stop laughing.

·

Hi Piotr. I often do engage. This has been a pretty crazy week for everyone.

I think this model is a great experiment and worth paying attention to. The only thing is that humans will always abuse whatever has a reward system in a bid to game the system. Also, the Turing test should take cognizance of cultural differences and uniqueness. Thanks for telling us about Idena.