The problem I have though is that when baking all keys, two specific joints are causing me trouble in the way that some of the baked keys are offsetted. See attached picture.
What's causing the problem? This causes the animated characthers legs to go crazy (including my head).
For anyone else that might run into this problem...
Turned out I needed to select all curves after I baked and use Euler filter availible in the graph editor.