M3 · Twenty Questions
Which Question to Ask First
Compute gini and entropy for a split and choose the better one.
Every question drops rows into two buckets. In a bucket, some rows say yes and some say no. A bucket that is all yes is pure. A fifty-fifty bucket is the worst kind, because it cannot lean either way.