With a run of three games without a win, the hosts aimed to end their winless form as Evelyne Viens' header beat Dijon goalkeeper Mylene Chavas off Camille Catala's fine cross in the fourth minute.
Sandrine Soubeyrand's team doubled their lead in the 16th minute after Clara Mateo fired past goalkeeper Chavas from six metres.
Dijon, however, pulled one back in the 28th minute when Lea Khelifi's effort from eight metres hit the left post before bouncing off the head of Nnadozie into the back of the net for an own-goal.
After the break, Viens started another attack for the hosts before only having defender Lena Goetsch to beat for her second of the match and third for Paris 10 minutes into the second half.