Current Slide

Small screen detected. You are viewing the mobile version of SlideWiki. If you wish to edit slides you will need to use a larger device.

Entropy

  • Entropy characterizes the (im)purity of an arbitrary collection of examples.
  • Given a collection S (containing positive and negative examples), the entropy of S relative to this boolean classification is
   
 
  • p + / p - is the proportion of positive/negative
    examples in S.
  • Entropy is 0 if all members of S belong to the
    same class; entropy is 1 when the collection
    contains an equal number of positive and
    negative examples.
  • More general:

Speaker notes:

Content Tools

Sources

There are currently no sources for this slide.