Orange unfortunately blocks manually updating the DNS servers for my own network, since I wanted to have my home server running dnsmasq, I went ahead and found a way around this limitation. It does, however, get reset to original values when the router is restarted.
Login to the admin page of the router and navigate to Advanced Settings > DNS.
Inspect the DNS field and go to the console tab. We want to run the following commands inside the advanced_network_dns.htm
frame context.
Update the IPs as needed.