https://blog.joystream.org/sumer-kpis/#13.6 We believe a lot of the contributors are not capitalizing on the work they are doing on the testnet(s). Some statistics: - Total platform Memberships: 2434 Member that have submitted scores (including up to Scoring Period 9 only): 736 - Total >0 submissions: 1819 - Members that have earned >0 for every Scoring Period: 37 - Members that have earned >0 for all but two or fewer Scoring Periods : 34+47 - Graded submissions per Scoring Period: [15,562,287,122,143,139,144,140,144,123] - Direct scores per Scoring Period: [9550,90420,35190,18840,21080,34645,31245,28145,33035,25660] - Referral scores per Scoring Period: [0,6442,2679,1590,1812,2403,2055,1458,1458,1747] - Average direct scores pr submission by Scoring Period: [637,161,123,154,147,249,217,201,229,209] Some worrying signs: - There are fewer submissions per Scoring Period - There are fewer points awarded per Scoring Period - This is partially due to re-calibration, but shouldn't be the case for the last 6 or so rounds, and it's still crashing - Our statistics indicate that very few of both CMs and workers are reporting their activities - Although there are some known reasons for this development, we want to know more! # Scope of Work For all of the above: - Getting the verbose FM points data needed can be found here ctrl+f of cmd+f the memberId or memberHandle to find that person (you may have to download the file) - What you need is the directScores for each round they are indexed from Scoring Period 0 and upwards Assemble more data for CMs: - Doing work on the Council is supposed to be the best/most efficient way of earning FM points - Use the KPI grading results, available for Sumer and Antioch to find out the memberId and memberHandle of the CMs was for Council Term. - Take advantage of the fact that each Scoring Period, starting from round 1 lasted two weeks, and figure out which Scoring Period each Council Term "belongs" in - Find out how many points all the CMs earned per Scoring Period (even if 0), and whether they were CMs in "both" Terms or not, and write it up Note that: - some may have reported their activities in the "wrong" round - some will have reported other activities - do your best thinking here, and return the number of points you think they earned in the round they (may) have reported their CM KPI work - the CMS that reports their Council KPI rewards, should earn a (roughly) "fixed" amount of FM points pr KPI $ earned Assemble more data for workers: - Being part of a WG is supposed to be another key way of earning FM points: - You can ignore rounds from before the release of Antioch - 7th April 2021 (eg. start from Scoring Period 5) - Using on-chain data, find the memberId and memberHandle that was active in a role at the end of each Scoring Period Hints: - Use the KPI gradings to find an approximate blockHeight corresponding to that date (will be <14400 off - good enough!) - Create a script, or use the javascript playground to find the active workers for each of the WGs (the operations WG didn't exist before #717987) - Once you know who was hired as worker for each group during each Scoring Period, find out how many points each of them earned per Period, and write it up Note that: - some may have reported their activities in the "wrong" round - some will have reported other activities - do your best thinking here, and return the number of points you think they earned in the round they (may) have reported their WG work Assemble data for bounties: - Bounties are another great way of earning large "chunks" of FM points, although not as recurring as the other two - Use this json to get the "closedDate" and the corresponding github issue to figure out who was paid out for each bounty completed after - - the FM program launch. You can also ask the Council Secretary for more info - Find out whether points the bounty solver earned points for their work, and write it up Note that: - some may have reported their activities in the "wrong" round some will have reported other activities - do your best thinking here, and return the number of points you think they earned in the round they (may) have reported their Bounty work - much like for CMs, the FM points awarded should be roughly proportional to the $ earned on a bounty Combine the data: - At this point, you should be able to identify roughly whether the user reported their work from 1, 2 or 3 - If you need more information, you can ask the user themselves for "full" information (if they kept it), or blrhc#0162 / bwhm#6514 on discord for some more information on specific summaries on Discord - Knowing that some will have reported other activities as well, try to estimate what was earned from what You have now separated the source of points, and can produce a report with: - the raw data gathered, in MS excel/google sheets/mac number/open office or json format CMs - For CMs, knowing that CMS that reported their Council KPI rewards, should earn a roughly "fixed" amount of FM points per KPI $ earned, estimate which CMs submitted their CM KPI work in their scores: From all the Councils: how many out of all reported their work? - How many FM points (estimate) is a CM awarded per KPI $ earned? - How many KPI $ was earned? - How many FM points was awarded? - How many FM points was "lost" - both in total and for the individual CMs? # Workers - For workers, it may not always be the case that they earn points solely for being in the WG. They may be awarded extra for actual activity, but assume they're not For all the WGs: how many out of all reported their work per Scoring Period? - How many FM points (estimate) is awarded per week of being hired in each WG (if they reported)? - How many FM points are the Leads awarded? - How many of the workers, for each WG, submitted their scores in each Scoring Period out of the total possible? - How many FM points was awarded? - How many FM points was "lost" - both in total and for the individual Workers? # Bounties For Bounties, knowing that you earn a roughly "fixed" amount of FM points per Bounty: - How many FM points (estimate) is bounty $ worth? - How many FM points was awarded from bounties? - How many FM points was "lost" - both in total and for the individual bounty solver?

This issue is not part of KPIs any more. Guess it can be closed