My preferred weapon of choice is a coarse flap disk in a grinder. If used gentlly it'll remove material very quickly.
An ordinary grinding disk will do the job, as would a large, coarse round file.
Just a matter of patience, test fitting often + a little more fettling.