500 Server Error on mybinder.org

Hi, I’m periodically getting a 500 server error when attempting to access https://mybinder.org/ .

Is there a secondary site we can go to monitor for outages?

By secondary, do you mean besides the status page?

It is usually transient when you get that error. For example, I saw it earlier this morning and then it worked.
Oh wait, the 500 error is back and I see ’ Binder launch success’ showing nothing. Maybe this is how that that state is reflected there?

@fomightez , I appreciate the reply and pointing me to that status page. That was exactly what I was looking for, but I was also wonder if there is any scheduled maintenance that might be attributed to this error.

Is there a mailing list I can subscribe to for any scheduled maintenance or server upgrade outages?

It appears the error is gone now for me.

1 Like

Yes, it seems an intermittent issue.

There’s a gitter channel there and somebody posted earlier today saying they were having trouble launching and that ’ Binder launch success’ graph was not showing anything; however, no one replied yet.
I have seen no mention of scheduled maintenance in the other gitter channels concerning it either; however, I’m not 100% sure these are the only channels used these days for the main communication between those responsible.

Dear @moronidav,

Thanks for the message.

First, mybinder.org operates as a federation. You can read more about it at The BinderHub Federation — Binder 0.1b documentation.

Is there a secondary site we can go to monitor for outages?

mybinder.org status — Binder 0.1b documentation will show you the status of all members of the federation.

https://grafana.mybinder.org will show you more details of the federation.

You can make enquires at

  1. this Jupyter Discourse Forum
  2. the Gitter / Matrix instant message
  3. the GitHub repository

When enquiring, please provide a copy of the launch / build log. Without the log, we don’t know what server you were redirected and we can’t investigate.

2 Likes

It was upstream of that where the issue in the last 24 hours was happening. It was the main mybinder.org page. It would intermittently just be a 500 error when you tried to open the page.

1 Like

That’s correct.

Now the https://mybinder.org page is returning a 503 “Service Temporarily Unavailable”.

@rgaiacs I appreciate the instructions. Ultimately, this does affect the loading of pre-existing binder builds, but as you can see this issue is upstream and affects everything downstream.

I’ve been using mybinder to build and load pre-built binders pretty regularly for the past 4 months, and this is the first time I’ve encountered an outage of this magnitude.

1 Like

Dear @moronidav,

This is fixed now. Thanks @manics.

@rgaiacs, Thank you for confirming the issue has been resolved. I can also confirm I am no longer getting server errors.

Do you have a changelog I can reference for server updates/fixes/patches?

There were no code/deployment changes, it was due to stale container images taking up too much disk space. Kubernetes normally automatically cleans things up, but for some reason it didn’t.

1 Like