It is common to have small issues in this area on raw machined slides that need to be touched up at the bench. During the machining process three different tools make cuts that intersect here. Your particular example is pretty bad, you are doing the right thing fixing that. A barrel locking lug file is quite handy for this area. Use a small stone to smooth out the small file marks and you will be good to go.