If I were hosting this competition, this is how I’d do it:
- Send 50 app submissions to 3 Googlers.
- Those 3 Googlers will judge each of the same 50 app submissions based on the following criteria (scoring them between 1-5): Remarkability, Creativity, Usefulness, Impactfulness, Execution.
- The average scores from those 3 Googlers will be recorded and used for judging each app as a whole.
- The host will shortlist the apps that scored the highest on each of the judging criteria.
- Then further refining the list till they figure out which app deserves which awards. Imagine an app that uses Firebase scores highly on all 5 categories will likely be picked as the winner.
Google is a large company. The hosts will surely get tons of volunteers at Google to help with judging criteria scoring. I mean who doesn’t enjoy watching new app creations?
This is how I imagined it’d work and why I competed in the first place. I’m randomly guessing everything here lol.
P.S. I agree that judging 3046+ apps by a few people ONLY would mean the competition will be HIGHLY subjective.
Also, they are most likely to follow the judging process I mentioned before that @Lloyd_Hightower said was spot on: