The transmission properties of a photonic crystal which was built by laser-micromachined alumina wafers are investigated. The crystal has a full photonic band gap from 89.6 to 99.8 GHz. By removing material from the crystals, millimeter wave defect structures have been created and localized defect modes observed. The measurements are in good agreement with theoretical simulations. The availability of such defect structures will be a key tool for the proposed millimeter applications of photonic band-gap materials