You don't need to "re-install traffic all the time". But you will find yourself in the situation where you update helm charts' values and you need to redeploy the chart.
The entrypoints can be (and should be) perfectly domain-less, and all annotations reside in IngressRoutes.
see :
not a helm chart but a vanilla deployment.