What type of material should I use to fill an expansion joint.

You can fill an expansion joint with silicone caulk, however it is recommended to use an elastic epoxy seam sealant after the grout is fully cured, such as Chockfast Expansion Joint material.