A downside is all pages built with a particular theme share the same layout. For example, in the Pygame docs the same Jinja2 templates generate the index page, module reference pages, and tutorial pages. So if you want a sidebar on one page, you get it on all pages. And I imagine to get around this needs another level of complexity, such as multiple document trees with each tree using a different theme.