The xds is small but not small enough to conceal comfortably in your pockets.
I have yet to find a subcompact in a larger caliber than 380 that can be comfortably be carried in any pocket. My Kahr CM9 is very small, but it's only good for fitting in a jacket pocket. My dad's Kahr P380 is the same size as an LCP, and THAT gun is small enough for pockets.
The XDs is ideally an IWB gun. Get a good holster and you will completely forget it's there.