I say get the Colt. I'm back down to one Kimber that I'll keep, but multiple Gunsmiths in this area have told me Kimber's metallurgy is far below Colt's. One told me the metal on a Kimber feels softer to cut than a WWII issue Colt gun. Another told me when he checkers the front of a Kimber (the steel ones!!) it's like cutting aluminum.
I do like my Kimber, love it actually, but it's a series one, has the correct 1911 extractor, and I've replaced most of the MIM and plastic parts with Wilson Combat steel. I've changed the hammer, sear, trigger, grip safety, MSH, and extractor. I also put night sights on, and had the front strap checkered. If I bought the XSE Colt, I'd put night sights on, replace the grip safety and MSH, and checker the front. I wouldn't need to replace the extractor, hammer, or trigger, because they're all fine.
Both guns have front and rear cocking serrations, and I find the Colt's to be more appealing. Kimber's are just too widely spaced. Plus the Colt has that little Horsey, and Ajax double diamond grips with Colt Medallions are superb. You can't really put those on a Kimber, now could you?