The administration of medication by insertion of a tiny needle or catheter into the spinal sac or epidural cavity.