We present the perturbation theory of the Chern-Simons gauge field theory and prove that to second order it indeed gives knot invariants. We identify these invariants and show that in fact we get a previously unknown integral formula for the Arf invariant of a knot, in complete agreement with earlier non-perturbative results of Witten. We outline our expectations for the behavior of the theory beyond two loops.