These are tools that assist with applying styles to elements. There are a variety of ways that this can happen.
The most common type of style library is a CSS processor. These take as input a language similar to CSS but with more features, and output standard CSS that the browser can understand.
The other tools are more varied. They might help you manageinline styles, help you write your CSS in JavaScript, or help you keep styles isolated to a particular component.