Membee’s Data Center Back to Normal

Good Morning Everyone,

As promised, we wanted to post some detail regarding the issues with our hosting provider that affected the services of Membee on Friday, July 3.

We are including the incident report provided to us by our hosting company, Tenzing for you below:

“Investigation of this incident has determined a major hardware failure on the primary firewall occurred which prevented the device from being restored.

 

The initial fail over to the secondary firewall did not perform as expected and over the course of this incident the secondary firewall stopped serving traffic multiple times until it was ultimately removed from its role as primary.

 

It was later determined that the secondary firewall was experiencing an unrelated hardware malfunction causing the device to periodically drop its routes. Each time, a restart was initiated to restore service. Analysis has led us to believe that this condition was present prior to the incident but went undetected by the firewall’s monitoring and diagnostic systems.  It was not until traffic was routing through the device consistently over a period of time that the malfunction could be detected.

 

Both firewalls have been replaced and will be returned to our vendor for further analysis.  High-availability of the network has been restored and the network is performing as expected.”

We have been monitoring our systems since the incident and are happy to report that everything is up and running as expected.  We are always committed to ensuring that we can deliver worry-free performance to all our users and your members and we will continue to work with our partners to ensure that this is maintained.

You can find some great information on how we keep our systems up and running and your data safe by visiting us at http://membee.zendesk.com/entries/20982867

 

As always, we wanted to keep you in the “loop”.

Thank you,

Membee Customer Service Team

Membee Services are Restored

Hi everyone,

The services are up and running again. We will continue to monitor everything here.

If you encounter any issues with accessing Membee, please email us at support@membee.com

We will post an update here once there is more information available.

Thank you for your patience,

Membee Customer Service Team

Service Disruption

Hi Everyone,

Today at 2:30pm MST, Membee’s hosting provider is experiencing a service interruption that is affecting all current services within Membee.  We are working as with the provider’s support team to restore services as quickly as possible.

We will post an update once we have more information available.

 

Thank you for your patience,

Membee Customer Service Team

Membee is Back Up!

Hi Everyone,

The services are back up and we are continuing to monitor everything here. If you encounter any issues with accessing Membee, please email us at support@membee.com

We’ll post an update here once more information regarding the interruption is available.

Thanks,

Membee Customer Service Team

Membee Service Disruption

Hi Everyone,

This morning at 11:15 AM MST, Membee’s hosting provider is currently experiencing a service interruption.  This effects all current services within Membee.  Support teams are engaged to restore services as quickly as possible.

We will post an update once we have more information available.

 

Thank you for your patience,

Membee Customer Service Team

Membee’s Reports & Exports Service Get An Upgrade

On an average day (measured January 1, 2015 to April 30, 2015), Membee processes as many as 1,265 reports and exports per day and on average, each of those processes takes a meager 18.29 seconds to complete. That’s really fast!

The thing about data services that do a lot of “heavy lifting” such as Membee’s Reports & Exports services is that great performance can slide to irritatingly slow performance rather quickly. And when this happens, you have scramble.

Scrambling disrupts the hive so in the wee hours of Sunday, May 3rd, we basically doubled the capacity of the Reports & Exports service to avoid any sort of a slow down and to add some capacity for some Membee enhancements we have in the development pipe.

We’re just keeping you in the loop!

Server Update Required – Membee Will Be Offline for 2 Minutes Early Dec. 10

Hi Everyone,

Sometimes things can be too new. While the massive upgrade to Membee’s server infrastructure went off without a hitch this past weekend, it appears the normal updates to Microsoft’s Windows Server 2012 has introduced a minor issue. It looks like a required update from Microsoft to address a potential security vulnerability in the Windows Server 2012 operating system may prevent users from connecting with their copy of Membee if they are using the Google Chrome browser. Not all users accessing their copy of Membee using Chrome are affected. Weird.

Thankfully, Microsoft has re-released the update and we will be applying it to Membee’s web servers early on the morning December 10. At 5:15 AM EST (UTC -5), we will stop traffic to Membee and trigger a reboot of the web servers so the update can take effect.

The whole process will be done inside of 2 minutes.

We’ll then test Membee in Chrome and hopefully that addresses the issue for Membee users who like to use Chrome.

Follow the link below if you’re interested in the back story on this Microsoft update:

https://support2.microsoft.com/kb/2992611/en-us

Thanks,

Membee Customer Service Team

Membee is Back Online – Data Center Upgrade Complete

Whew! That was a long night but everything is done. Membee came back online about 15 minutes ago.

We finished up about an hour early.

We completed our testing checklists and Membee seems to be running spendidly in its new home. Secondary testing will be completed throughout the rest of the day.

We’re hoping that you’re taking the weekend off but if you are working in Membee and encounter a problem, let us know right away by emailing the details to us at support@membee.com.

Enjoy the rest of the weekend!

Membee Customer Service Team