Two issues come to mind. First, you'd be working against the grain, which is rarely a Good Thing. Second, rubbing/buffing compounds are too fine to start the process. You could perhaps use them to finish once you were up to needing 2000+ grits, but by that point you may as well just finish off...