You can’t really exclude anything except the USB port and the FET and resistor used for reverse polarity protection…everything else is needed for the Imp or the 3.3V regulator.
If you want to work with April, and you can use Eagle, Sparkfun has their version of April posted as an Eagle project. You’ll want to leave the support components around the regulator as they are, but you could move the header pins back and remove the USB and battery pads to save a little room.