Proactively Learning on SplitClub