What are the steps in getting a new structure tied into the cities sewer/water utilities? Do ordinary plumbers do this or do you have to get a specialist to perform this work? Would anyone know what permits are necessary, what is all involved to get this taken care of?
That's your contractor's responsibility.
Yes you will need a plumbing permit, most plumbers will work with an excavator to dig the trench to the sewer. Contact a licensed and insured plumber in your area (ask around for references). They will run a trench from your exisiting drain lines to the sewer and make a connection, same with your water supply lines if needed.