davidgasquez.com / handbook
📚 Personal bits of knowledge
fork atom

📝 Update resources section

davidgasquez.com e95e8419 8d4338ff

+7 -4
unified split
-4
Impact Evaluators.md
··· 161 161 - [Impact Evaluator Design](https://youtu.be/1soPQ31ZHkQ) 162 162 - [Impact Evaluators](https://youtu.be/dpLtrugjfMc) 163 163 - [Generalized Impact Evaluators, A year of experiments and theory](https://research.protocol.ai/blog/2023/generalized-impact-evaluators-a-year-of-experiments-and-theory/) 164 - - [Elo vs Bradley-Terry Model](https://www.keiruaprod.fr/blog/2021/06/02/elo-vs-bradley-terry-model.html) 165 - - [Designing a Better Judging System](https://anishathalye.com/designing-a-better-judging-system/) 166 164 - [Deliberative Consensus Protocols](https://jonathanwarden.com/deliberative-consensus-protocols/) 167 165 - [Credible Neutrality](https://balajis.com/p/credible-neutrality) 168 166 - [Quadratic Payments: A Primer](https://vitalik.eth.limo/general/2019/12/07/quadratic.html) 169 - - [Quadratic vs Pairwise](https://blog.zaratan.world/p/quadratic-v-pairwise) 170 167 - [Quadratic Funding is Not Optimal](https://jonathanwarden.com/quadratic-funding-is-not-optimal/) 171 168 - [A Mild Critique of Quadratic Funding](https://kronosapiens.github.io/blog/2019/12/13/mild-critique-qf.html) 172 169 - [Funding impact via milestone markets](https://docs.fileverse.io/0x0D97273dee4D1010321f9eBa2e9eaB135C17D6dE/0#key=5GgcacTDy2h1QwWV9vJqGD-YzwomzuIOueMACpjghbJLxfG3ZqbWl1qDC1Le04uR) ··· 200 197 - [Ostrom's Common Pool Resource Management](https://earthbound.report/2018/01/15/elinor-ostroms-8-rules-for-managing-the-commons/) 201 198 - [Community Notes Note ranking algorithm](https://communitynotes.x.com/guide/en/under-the-hood/ranking-notes) 202 199 - [Deep Funding is a Special Case of Generalized Impact Evaluators](https://hackmd.io/@dwddao/HypnqpQKke) 203 - - [An Analysis of Pairwise Preference](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3359677) 204 200 - [Analysing public goods games using reinforcement learning: effect of increasing group size on cooperation](https://royalsocietypublishing.org/doi/10.1098/rsos.241195) 205 201 - [CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement](https://arxiv.org/pdf/1808.06080) 206 202 - [Coevolutionary dynamics of population and institutional rewards in public goods games](https://www.sciencedirect.com/science/article/pii/S095741742302081X)
+7
Pairwise Comparisons.md
··· 24 24 - Use robust methods (crowd BT, hierarchical BT, [Bayesian variants](https://erichorvitz.com/crowd_pairwise.pdf)) to correct annotator bias and uncertainty. 25 25 - Expert jurors can be inconsistent, biased, and expensive. [Large graphs of comparisons](https://arxiv.org/pdf/1505.01462) are needed to tame variance. 26 26 - You can report accuracy/Brier by using [bootstrap](https://en.wikipedia.org/wiki/Bootstrapping_(statistics)). 27 + 28 + ## Resources 29 + 30 + - [Elo vs Bradley-Terry Model](https://www.keiruaprod.fr/blog/2021/06/02/elo-vs-bradley-terry-model.html) 31 + - [Designing a Better Judging System](https://anishathalye.com/designing-a-better-judging-system/) 32 + - [Quadratic vs Pairwise](https://blog.zaratan.world/p/quadratic-v-pairwise) 33 + - [An Analysis of Pairwise Preference](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3359677)