PVC is approved and commonly used for water supply (The line from the municipal main to the house main shutoff valve.)
For supply service it is common to use a PVC male thread adapter that is threaded into a copper female thread adapter. (The code prohibits using a PVC female adapter).
PVC pipe is fairly flexible and will tolerate some bending but it is best not to have the point of stress on a joint. The solution would be to dig back a foot or so on both ends of the joint, realign the pipes and install a short lenght if necessary to spread the stress out over a short distance.
