PEP-41: IDentify Efficiencies And Suggestions (IDEAS)

Edited 09/20 to change recipient/custodian to Foundation.

Attributes

  • Authors: @b3n @Ming
  • Recipients: Contributors via the Foundation
  • Category: Bounties
  • Asking Amount: $10k USD of POKT, $5k to be immediately converted to USDC

“None of us is as smart as all of us” - Ken Blanchard

Summary

TLDR: We are seeking a small grant to prototype and test an incentive reward mechanism for community ideas and suggestions.

Each day on this forum and numerous Telegram and Discord channels, the community discusses how to make Pocket Network a foundational piece of infrastructure. Primarily these discussions focus on high-value, strategic proposals and grants for significant undertakings.

But there are other smaller, but perhaps no less impactful, ways to empower the community and core teams to create value collaboratively. Smaller, because nothing is too small when you want to build a culture of the highest quality, and no less impactful because every incremental improvement adds up and ultimately compounds over time. This statement is not just a hope - it is outlined in the theory of Marginal Gains:

Marginal Gains theory outlines compounding effects that lead to highly differential outcomes, and the approach has realised numerous real-world results. It espouses first principles thinking by breaking things into components to find new opportunities.

Our ambition for this proposal is to incentivise everyone in the Pocket community to share their knowledge, context, and creativity to help Pocket make gains at any scale that add up to a big difference over time.

How it works

We share thoughts and feedback through numerous channels but generally speaking, it is difficult to answer:

  • If I want to share feedback to help Pocket improve, where do I go?
  • What are the most important improvements the community and core team want to see?

Our mechanism aims to incentivise the behaviour of sharing ideas or opportunities in a more structured and transparent way.

The mechanism creates a shared “Community Suggestions” funnel in Dework: https://app.dework.xyz/pokt-network/suggestions

Any community member can provide a suggestion here, and through an automation with Discord, it will be added to a #suggestions channel and our community suggestions backlog.

In the suggestions backlog, community members can further participate by upvoting suggestions they think are valuable. The core team will use this feedback as input for their own improvement efforts and backlog. When specific community-recommended suggestions are activated or actioned, the core team will have the ability to reward the individual who provided this suggestion with a discretionary amount of $POKT.

Note: PEP 40 provides further explanation of how actionable work can also be bountied back to the community for completion.

Motivation/Rationale

The main motivation is to seek out and action efficiency opportunities and suggestions from the wider community and embed in Pocket Network a focus on continuous improvement and quality.

That said, there are numerous second-order benefits to experimenting with an incentive mechanism like this, including:

  • Reduce the friction for anybody to participate in helping improve Pocket
  • Provide opportunities for the community to share their creativity and innovation and signal their general sentiment
  • Create richer, more specific, and actionable feedback for different teams
  • Encourage and reward people who make helpful suggestions to Pocket without the explicit expectation of a quid-pro-quo for participating

Budget

We seek an equivalent budget of $10k USD of POKT for a 4-month experiment. Candidly, we do not know if this will be an appropriate budget, but we intend this experiment to happen very publicly and to provide monthly updates of how the funds are being deployed. We also welcome here now further discussion from the community as to whether this budget seems reasonable.

To add, we think there are numerous hypothetical examples of security or sales improvement suggestions that might be deserving of the whole $10,000USD budget on their own, but for now, we want to focus on increasing the volume of small improvement suggestions and to fine-tune the mechanism to most effectively leverage this budget for the Pocket ecosystem over time.

Dissenting opinions

  • The budget is too small to do anything meaningful

    This is a prototype and test. If successful, we will return to increase or expand the budget

  • People should provide suggestions without being rewarded or incentivised

    Yes, and we hope they will continue to do so. But this is a small way to recognise those people without creating an expectation of reward and to drive some engagement as we stand up this mechanism

  • There are better ways to spend $10k

    Everyone can always debate this. Or, now, they can add a better idea to the suggestions mechanism, and people can upvote if they agree :wink:

Copyright

Copyright and related rights waived via CC0.

2 Likes

Hi @b3n,
I agree that all suggestions and ideas should be considered but proposing a certain thing and analyze its impact and/or implementation are completely different things. Anyone can propose a change but only a few take the time to create a viable proposal from that idea.

I have a few questions:

  • What is exactly a “Community suggestion”? Is it a simple idea, such as: “Let’s give more rewards to nodes with more staked POKT” or is it the concept of how it should be done (like PIP-22)?
  • If the suggestion is just a simple idea; it will be easy to post anything and the suggestions input could be full with unfeasible things. I also find it hard to reward someone for a simple statement, ideas are free, implementations matter.
  • If the suggestion should contain a certain amount of analysis; Whats the difference between these suggestions and a PIP?
1 Like

Thanks for these questions. Answers below, noting that this is a prototype/experiment and answers will be more clearly defined together with the community over time.

  • What is exactly a “Community suggestion”? Is it a simple idea, such as: “Let’s give more rewards to nodes with more staked POKT” or is it the concept of how it should be done (like PIP-22)?

Community suggestions is primarily about identifying marginal gains for how we improve operational effectiveness, so I expect suggestions to generally be smaller in scale and more focused towards operations/ecosystem type suggestions rather than protocol specific. That said, feature requests or other (small) technical items could be suggestions.
Here’s a personal suggestion as an example: We need a “Who’s who” type page or discord channel so we know who does what and through this transparency reduce our reliance on tribal knowledge.

  • If the suggestion is just a simple idea; it will be easy to post anything and the suggestions input could be full with unfeasible things. I also find it hard to reward someone for a simple statement, ideas are free, implementations matter.

Agree, implementation/execution is more valuable which is why we have requested only a small budget. We have created templates in dework for structuring suggestions so they are captured in a more valuable and easier to assess way. I expect this to work hand-in-hand with PEP42 so that we have small rewards for suggestions/opportunity and then larger bounties for things that move to implementation. Regarding unfeasible things, I’m pretty confident the community will only upvote things they think are valuable/feasible.

  • If the suggestion should contain a certain amount of analysis; Whats the difference between these suggestions and a PIP?

Scale/size. We expect suggestions to be smaller in nature (and as shared above more towards operational/ecosystem than product/protocol)

3 Likes

This is a great idea. Yes immediate conversion of half to usdc makes sense. I tested out the website - a couple of suggestions:

  • It would be nice for the author of a suggestion to be able to edit its content and possibly to withdraw it. (LOL, I created a test post to see what functionality it includes and now can’t delete it)
  • I assume there will be a mod to remove postings that it deems to be inappropriate (Like my orphan test suggestion ;D )
  • It would be nice to enable comments to a post. This can serve a couple purposes:
    -it can provide context to why someone voted to downvote a suggestion, giving the contributor opportunity to fix the perceived defect leading to downvoting
    -more importantly, it can allow the community to start suggesting refinements and/or potential paths of implementation.

Continuing the above concept, once a suggestion is sufficiently upvoted, it could then be opened for community to brainstorm the intermediate space between a suggestion and the core team developing. E.g., continuing the example you gave above, “We need a Who’s who type page” another contributor might add, "I suggest hosting this on the Resources tab of forum.pokt,network; make it a pinned topic in the tab, and have it link to a google sheet where it is populated with not only official whos who but also contains “tribal knowledge” of who informally has a reputation of being able to help in different topic areas. A pinned message on the discord Welcome tab could point to the same " Then both top suggestions of topics and top suggestions of how to implement an upvoted topic can get rewarded… This may give you a lot more bang for your buck.

2 Likes

Thanks for testing the functionality and providing great feedback and thoughtfulness around how we operationalise this… it’s greatly appreciated (fyi i deleted your test suggestion too).

I’d love to work with you and anyone else in the community that wants to help us activate this and help it become an engine for optimising Pocket together. I’ll put some thought into how a small working group could form around this…

RE some of the suggestions, we will take on board and also explore what is on the Dework roadmap… they ship fast and may be able to help us with these functionalities but I expect there will still be some limitations as to what we can do

1 Like

I support this proposal.

2 Likes

The example suggestion itself is actually good. These small suggestion might be exhausted pretty quickly but thats why its good to start with a small amount of compensation.

One thing worth mentioning, especially at this scale, is the feedback loop; it needs to be short enough to sustain momentum E.g. weekly review of highest voted suggestion and quick reward for doing so.

3 Likes

This proposal is now up for voting Snapshot

This proposal was approved with 18 approvals and 0 rejections. Snapshot

2 Likes

Well done on passing this, will be interesting to see how it develops.

Can I suggest (may need another vote, but hopefully just a best practice implementation at this stage: Set a minimum bounty to offer every suggestion that get’s passed.

It doesn’t have to be a huge amount, maybe 1000 POKT (or 500POKT/$50 etc) but setting a floor at least encourages everyone to participate and gives a small but meaningful reward to those who might offer a good idea that helps the community even if it didn’t need a huge amount of background research/analysis/modelling etc.

3 Likes

I really like this suggestion and support it. I will communicate more on this but expect the equivalent of $50USD is a reasonable minimum.

First thing first thought, please add this as a suggestion in Dework :wink:: https://app.dework.xyz/pokt-network/suggestions

3 Likes

IDEAS Update - Program Month 1 (October 2022)

October was the first completed month of the IDEAS program and full month results and retrospective are provided below.

Note: Program details are posted above and suggestions can be accessed in full here: https://app.dework.xyz/pokt-network/suggestions

Results:

In October we received 8 high quality recommendations. These are provided below along with feedback and agreed actions, ranked by community upvotes:

  1. Suggestion 1 - Pre-proposal category in forum

@zaatar , @Jinx and @steve worked together to create the GRIP proposal . One associated recommendation is to create a pre-proposal category for debate on proposals. We believe this can add value to the proposal and feedback process and is accepted for imminent implementation.

Reward: YES

Value: $400

  1. Suggestion 2 - Incentivise bug bounty program

@poktblade recommended to explore, through research, how we can increase the security of Pocket Network through increased visibility, enhancement or rewards to a bug bounty program. This research will soon be shared in the forums. Security of our protocol is a high priority and this contributes to a valuable conversation.

Reward: YES

Value: $200

  1. Suggestion 3 - Provide an abstain option for DAO votes

@steve recommended the DAO offer an abstain option in voting. This allows engagement on voting topics and signalling of participation, without being compelled to add weight to one of the available choices. This will be added to an upcoming PIP for discussion and implementation. It has been added to the DAO roadmap.

Reward: YES

Value: $200

  1. Suggestion 4 - Add reward endpoint to Pocket core

@addison recommended the creation of a reward endpoint to alleviate some current pain points for developers. The engineering team understands the importance of this data and will be exploring ways to further provide it. The team is not fully committed to a reward endpoint at this time.

Reward: YES

Value: $200

  1. Suggestion 5 - Change the requirements for the Seedbank trophy

@steve recommended a change to the seedbank trophy to allow social “vouching” as opposed to BrightID. This is a pragmatic suggestion that has merit. It has been accepted and will be added to the DAO roadmap.

Reward: YES

Value: $200

  1. Suggestion 6 - Set a minimum compensation level for IDEAS

@Cryptocorn suggested that all community suggestions (IDEAS) receive a minimum reward of $50 in POKT or USDC. We agree that creating clarity around a minimum reward is valuable to incentivise further suggestions such as those received this month. We want to note that this is for valuable, focused and accretive suggestions and will not become a “pay for play” type arrangement that could lead to spamming. This has been accepted and is implemented as part of this report.

Reward: YES

Value: $200

  1. Suggestion 7 - Create a testnet tokens faucet

Aurel recommended to create a testnet tokens faucet to increase visibility and brand awareness of Pocket. This is an interesting idea but there is currently no evidence that this would lead to further conversion, and of course requires development time which is focused on current priorities. It may be something others in the community choose to explore.

Reward: YES

Value: $100

  1. Suggestion 8 - Increase transparency via a public dashboard

@addison shared the LIDO dashboard which drove a lot of convesation and sharing amongst various team members. The idea of creating further transparency and alignment to some progress measures and focus metrics is appealing and will be further pursued. The specific approach or implementation will be further fleshed out and shared back in due course. Thanks Addi for stimulating more focus on this question.

Reward: YES

Value: $200

Retrospective:

The IDEAS mechanism seems to work well via Dework which indicates we can further scale the volume of community suggestions and feedback. Other learnings and insights include:

  • The tool is simple and community members are signalling their support by upvoting suggestions. This upvoting and prioritisation will become more important as volume increases (and we may only address suggestions with some defined level of support)
  • The suggestions provided are all high quality. Thankyou as always to our thoughtful community. While maintaining quality, we believe there is opportunity to identify more, smaller suggestions that can have impact. This can be in the form of feedback - such as where docs, conversations, materials, or other areas can also be improved. Please do consider other ways to help us engage in 2-way dialogue on ways that make Pocket better
  • Some contributors and providers of suggestions needed an additional prompt to use the IDEAS mechanism in Dework. We want to habitualise the behaviour of adding suggestions to Dework. We will provide further communications to help improve and we encourage everyone to try to keep a regular eye on the “Suggestions” channel in Discord where all new suggestions are automatically added
  • Overall, it is great to see the community have a systematised record of their ideas and suggestions; to make the link to Pocket teams for consideration, feedback and action; and to hopefully increase this sense of ownership each of us can feel about our ability to help shape Pocket for the better

Rewards:

Rewards are outline in the above updates for each of the individual suggestions. Rewards will be disbursed by the Pocket Network Foundation (PNF) and update on this will be communicated shortly. Contributors who have made suggestions should expect a short delay in payments.

Note: As this is our first experience rewarding suggestions, reward values are highly subjective. Below we elaborate on some of the reasoning applied, but we welcome discussion and feedback from the community:

Base reward for interesting and valuable suggestions: $50
Premium for supporting IDEAS mechanism by being early adopter: x2
Premium for an idea that leads to specific implementation or addition to backlog: x2
Premium for higher value idea that can unlock high value across Pocket: x2

Example:
PocketBlade Bounty suggestion:
Base reward: $50
Premium for early adopter of IDEAS: $50
Specific implementation: Not at this time
Premium for higher value idea: x2
Reward: $200

Program funds:

  • 10K USD of POKT

Suggestion Rewards month 1:

  • 8 Suggestion at total of $1700 USD of POKT

Balance:

  • $8300 USD of POKT

Burn rate:

  • $1700 pm. Runway of 4.88 months

Note: These rewards will be paid out at the 30 day (Oct) average price from CoinMarket cap of POKT. This price is 0.0717

4 Likes

IDEAS Update - Program Month 2 (November 2022)

November was the second month of the IDEAS program (Community Suggestions). Details of the program are above and provided suggestions can be accessed in full here: https://app.dework.xyz/pokt-network/suggestions

Results:

In the month of November, we received 3 high quality community suggestions, ranked below by community upvotes. Feedback from responsible teams and agreed actions for each are:

  1. Suggestion 1 - Define what is a small node runner - @RawthiL

Thanks for this suggestion and for the intention to further understand the composition of our SNR(small node runners). We agree it is useful to better understand how many of these “small” node runners exist in the ecosystem.

As a finger in the wind, a small node runner could have approximately 15 nodes running, or we could perhaps define more broadly, especially since the adoption of Lean, a number of less than 50 nodes. If there are any good ways to quantify the number of nodes an individual is running (perhaps service URL) we will be able to better understand this. If you have further ideas for how we define or reach community consensus on this please reach out to @fredt

Reward: YES

Value: $400

  1. Suggestion 2 - Create a public DAO dashboard - @steve

SteveDabble suggested that we create a public DAO dashboard. The proposed PNF team agree in the need to create more visibility and transparency and will add to the DAO roadmap.

Reward: YES

Value: $200

  1. Suggestion 3 - Provide an “monthly mulitiplier” to focus suggestions on specific topics - @Cryptocorn

The multiplier method provides a simple algorithm for retroactively pricing community suggestions. Providing a monthly multiplier can increase alignment and hopefully stimulate focused suggestions. We will add the monthly multiplier and provide clarity for thematic or focused suggestions rewarded starting in January.

Reward: YES

Value: $200

Retrospective:

The IDEAS mechanism continues to generate suggestions that lead to adoption and provides a space for further dialogue between the community and different teams. Insights from this month include:

  • Valuable suggestions continue to be provided but are at a volume less than we would hope. We will make time to do a further push on the mechanism this month.
  • There is some merit in perhaps focusing or advancing on specific types of community suggestions or feedback. We will trial a campaign of this nature in January
  • The IDEAS program is itself an experiment. If community members have ideas about how it itself can be improved then please share directly with @b3n or on the community suggestions board

Rewards:

Rewards are outlined in the above updates for each of the individual suggestions. Rewards for October and November will be disbursed in the coming weeks.

Suggestions and rewards are highly subjective. We used the following reasoning when applying rewards in November:

Base reward for interesting and valuable suggestions: $50

Premium for supporting IDEAS mechanism by being early adopter: x2

Premium for an idea that leads to specific implementation or addition to backlog: x2

Premium for higher value idea that can unlock high value across Pocket: x2

Program funds:

10K USD of POKT

Suggestion Rewards month 2:

3 Suggestions at total of $800 USD of POKT

Balance:

$7500 USD of POKT

Burn rate:

$1250 pm. Runway of 6 months @ current rate

2 Likes

IDEAS Update - Program Month 3 (December 2022)

December was the thirds month of the IDEAS program (Community Suggestions). Details of the program are above and provided suggestions can be accessed in full here: https://app.dework.xyz/pokt-network/suggestions

Results:

In the month of December, we received 3 community suggestions, ranked below by community upvotes. Feedback from responsible teams and agreed actions for each are:

Suggestion 1 - Create a template for DAO Proposals

@Cryptocorn suggested that we build and share some downloadable templates for proposal submissions. It is our understanding from the GRIP proposal that this is something they planned to deliver. As Cryptocorn is a member of this group it does not feel appropriate to reward this suggestion, even if we agree it is a good one

Reward: NO

Value: $0

Suggestion 2 - Include more submission types in the Marketing Bounties

@Cryptocorn suggested that the community content bounties accept a wider and more diverse set of submission types, including memes and infographics. We agree this is a welcome addition but requires some further thought as submissions like memes would of course be very subjective. Jinx and team will take this into consideration and look to expand further.

Reward: YES

Value: $200

Suggestion 3 - Provide support for the NEAR blockchain through Pocket

Jordan Gray suggested that Pocket be available on other WASM chains like NEAR protocol. We agree and the good news is that NEAR is already supported by Pocket! Unfortunately for Jordan this means we cannot reward this suggestion.

Reward: NO

Value: $0

Retrospective:

We have less evidence to assess for the IDEAS mechanism as the December month was a quieter time for both the Pocket teams and the community. Keep an eye out for some further experimentation in January.

Rewards:

Rewards are outlined in the above updates for each of the individual suggestions. Rewards for December will be disbursed in the coming weeks.

Suggestions and rewards are highly subjective. We use the following reasoning when applying rewards in December:

Base reward for interesting and valuable suggestions: $50

Premium for supporting IDEAS mechanism by being early adopter: x2

Premium for an idea that leads to specific implementation or addition to backlog: x2

Premium for higher value idea that can unlock high value across Pocket: x2

Example:

PocketBlade Bounty suggestion:

Base reward: $50

Premium for early adopter of IDEAS: $50

Specific implementation: Not at this time

Premium for higher value idea: x2

Reward: $200

Program funds:

10K USD of POKT

Suggestion Rewards month 3:

1 Suggestion at total of $200 USD of POKT

Balance:

$7300 USD of POKT

Burn rate:

$900 pm. Runway of 8.11 months @ current rate

5 Likes