The FEI is the governing body for several equestrian disciplines. While their rules do not impact the majority of amateur or pleasure riders, they provide sound advice on whether pregnant women can ride horses.
Whether pregnant women ride horses is an individual decision. Only you and your doctor will know how you feel and the relevant risks for your pregnancy. The general thought is that if you are comfortable, you can keep riding until 12-weeks gestation.