Netflix SCG hypothesis ---------- problem specification of kind T of domain X. To win, Bob must beat Alice' algorithm by 10% on a data set given by Alice. 10% = improvement ratio Alice claims: There exists AliceAlg so that for all BobAlg there exists input x of kind T: not (BobAlg(x) >= 1.1 * AliceAlg(x)) problem ------- data set for specification, provided by Alice. solution -------- Bob delivers program implementing specification and achieving 10% improvement. Alice must deliver her algorithm to administrator for checking what Alice achieves. Spec/Test SCG hypothesis ---------- problem specification of kind T of domain X. To win, Bob must provide a program that gives the correct result for all 50 test cases provided by Alice. problem ------- Bob delivers program implementing specification. solution -------- 50 test cases, provided by Alice.