To whoever with this problem, please refer to this posting Trouble getting HTTPS / letsencrypt working with 0.9.0-beta.4 - #10 by matthew.brett
Run this command a few times (I did twice) to fix this:
kubectl delete pods $(kubectl get pods -o custom-columns=POD:metadata.name | grep autohttps-)
I have no idea how why though but it works.