You'd better start writing then :-)
At some level, you need to interface with the graphics drivers. Since Python is an abstraction layer over C, this means either writing in C (not Python), or using a package that does that for you. You must use some package in Python to do low-level graphics--whether you write it yourself or no.
For a package that gives you low-level access, my recommendation is PyOpenGL. It's lower-level than PyGlet and much cleaner, I think.
Ian