Refactors the sprite matrix handling to do most calculations in Dart, minimizes the number of calls down to Skia