Evolve IP Status

ECS Impairment

Monitoring - Engineers have addressed the issue and we will continue to monitor.
Apr 21, 14:20 EDT

Identified - The issue has been identified and Engineers are working towards a resolution.
Apr 21, 14:18 EDT

Investigating - We are currently investigating an issue with ECS. Our Engineers are active engaged and we will provide updates as they become available.
Apr 21, 14:13 EDT

Evolve IP Help Center Operational

Authentication and User Management Operational

Service Desk Portal Operational

UCaaS Operational

Telephony Operational

Applications Operational

Features Operational

Collaboration Operational

Evolve Teams Operational

Recap Operational

CCaaS (US) Operational

Telephony Operational

Applications Operational

Features Operational

Call Center Reporting Operational

ECS Operational

OSSmosis Operational

Admin Portal Operational

ECS Admin Portal Operational

WaaS Management Operational

DRaaS Operational

ZT East Operational

ZT West Operational

VE East Operational

VE West Operational

Cloud Backup Operational

DaaS 3 Operational

DaaS 3 Admin East Operational

DaaS 3 Admin West Operational

DaaS 2 Operational

DaaS 2 Admin East Operational

DaaS 2 Admin West Operational

IaaS Operational

RMM Operational

Virtual Data Center Admin East Operational

Virtual Data Center Admin West Operational

Clearlogin Operational

User Dashboard Operational

Admin Console Operational

Clearlogin Directory Operational

Password Manager Operational

AWS cloudfront Operational

Sync Operational

Web Interface Operational

Storage Operational

Sync Service Operational

Network Operational

DNS Operational

NTP Operational

Cloud Connect East Operational

Cloud Connect West Operational

Internet East Operational

Internet West Operational

Cloud Firewall East Operational

Cloud Firewall West Operational

Hosted Exchange Operational

HEX East Operational

Workspaces Operational

Vetanium Operational

blueprintCLOUD Operational

continuumCLOUD Operational

dvmCLOUD Operational

Managed IT Server Operational

Data Center Core Services Operational

Cleveland, OH Operational

Minneapolis, MN Operational

Norristown, PA Operational

Philadelphia, PA Operational

Las Vegas, NV Operational

Amsterdam, Netherlands Operational

Delft, Netherlands Operational

London, UK Operational

Northamptonshire, UK Operational

Third Party Cloud Services Operational

Microsoft Azure Operational

Microsoft Office 365 Operational

Cisco Web Security Operational

Mimecast Email Security & Archival Operational

Unity (Licensing) Operational

Unity (Chat) Operational

Trend Micro Worry Free Portal Operational

Tenfold CRM Platform Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

DaaS Apr 24, 23:00 - Apr 25, 02:00 EDT

Evolve IP Alert: Maintenance

Dear Valued Client,
In order to continue to provide world-class service and customer support, Evolve IP will be performing the following maintenance:

Start: Saturday, April 24th, 2021 at 11:00 PM EDT
End: Sunday, April 25th, 2021 at 2:00 AM EDT
Duration: 3 hours

Purpose: Evolve IP will be performing scheduled maintenance on the Service Provider components of the evolvedaas.com platform. This should not be service affecting for desktop connections or administrator portals.

Impact: In rare cases, a customers inventory job will run at the moment that the service center fails over during node update, resulting in a null return to the customer's inventory database. Customers may report an inability to login to desktops and inventory not populating in their enterprise center admin portal. A restart of the tenant enterprise center appliances will resolve this issue. Please contact Evolve IP support if you experience this issue.

For the duration, the Service Center portal will be inaccessible to Evolve Associates.

Remediation: The appliances are snapshotted by the horizon version manager in vcenter. To back out from updated02 and return to update01, Revert the snapshots on all patched appliances, then power on the appliances. Login to service center and validate that all service provider org 1000 appliances are status green.

Required user actions: No user action is required. Please contact Evolve IP support if you experience and issue during this maintenance window.

If you have any questions, please visit the Help Center portal at https://help.evolveip.net and submit a General Inquiry. If you have an urgent incident, please call the Evolve IP Help Center at 877.459.4347, Option 2.

Thank you for your attention and understanding.
_________________________
Evolve IP Help Center
https://help.evolveip.net
877.459.4347, Option 2
Posted on Apr 19, 11:48 EDT

Sync, Veeam, Zerto, vCenter Apr 27, 22:00 - Apr 28, 04:00 EDT

Broadsoft Apr 30, 23:00 - May 1, 02:00 EDT

Evolve IP Alert: Maintenance

Dear Valued Client,
In order to continue to provide world-class service and customer support, Evolve IP will be performing the following routine network maintenance:

Start: Friday, April 30th, 2021 at 10:00 PM CDT
End: Saturday, May 1st, 2021 at 2:00 AM CDT
Duration: 3 hours

Impact: We do not expect any interruptions to service during this maintenance, but there may be momentary delays for call setups and logins on certain client applications.

Remediation: None

Required user actions: None

If you have any questions, please visit the Help Center portal at https://help.evolveip.net and submit a General Inquiry. If you have an urgent incident, please call the Evolve IP Help Center at 877.459.4347, Option 2.
Thank you for your attention and understanding.
_________________________
Evolve IP Help Center
https://help.evolveip.net
877.459.4347, Option 2
Posted on Apr 16, 16:38 EDT

Cisco May 2, 00:00-05:00 EDT

Dear Valued Client,

In order to provide you with the best service possible, Evolve IP will be performing maintenance on network switch equipment in EvolveIP's Philadelphia Data Center

When: Sunday, May 2nd from 12:00 AM to 5:00 AM EST

Impact: During this maintenance services in the Philadelphia Data Center may become unavailable
Posted on Mar 25, 09:58 EDT

Clearlogin May 3, 22:00-23:00 EDT

Broadsoft May 7, 23:00 - May 8, 05:00 EDT

Evolve IP Alert: Maintenance

Dear Valued Client,
In order to continue to provide world-class service and customer support, Evolve IP will be performing the following routine network maintenance:

Start: Friday, May 7th, 2021 at 11:00 PM EDT
End: Saturday, May 8th, 2021 at 6:00 AM EDT
Duration: 6 hours

Impact: We do not expect any interruptions to service during this maintenance, but there may be momentary delays for call setups and logins on certain client applications.

Remediation: None

Required user actions: None

If you have any questions, please visit the Help Center portal at https://help.evolveip.net and submit a General Inquiry. If you have an urgent incident, please call the Evolve IP Help Center at 877.459.4347, Option 2.
Thank you for your attention and understanding.
_________________________
Evolve IP Help Center
https://help.evolveip.net
877.459.4347, Option 2
Posted on Apr 16, 17:10 EDT

Past Incidents

Apr 21, 2021

Unresolved incident: ECS Impairment.

Apr 20, 2021

No incidents reported.

Apr 19, 2021

Clearlogin

Completed - The scheduled maintenance has been completed.
Apr 19, 23:00 EDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 19, 22:00 EDT

Scheduled - Evolve IP Alert: Maintenance

Dear Valued Client,
In order to continue to provide world-class service and customer support, Evolve IP will be performing the following maintenance:

Start: Monday, April 19th, 2021 at 10:00 PM EDT
End: Monday, April 19th, 2021 at 11:00 PM EDT
Duration: 1 hours

Purpose:
Add password reveal option for JWT app secrets and hide secret by default.
Fix potential error on mfa selection page when an MFA provider has been improperly deleted.
Add “skip on failed authentication” feature to support redundant identity sources from causing multiple failed login attempts.

Impact: The system will be updated and should incur no downtime during the upgrade.

Required user actions: None

If you have any questions, please visit the Help Center portal at https://help.evolveip.net and submit a General Inquiry. If you have an urgent incident, please call the Evolve IP Help Center at 877.459.4347, Option 2.
Thank you for your attention and understanding.
_________________________
Evolve IP Help Center
https://help.evolveip.net
877.459.4347, Option 2
Apr 12, 11:01 EDT

ECS Reports Application Inaccessible

Resolved - A report indexing service had to be cleared and is operational.
Apr 19, 13:01 EDT

Monitoring - A fix has been implemented and we are monitoring the results.
Apr 19, 11:04 EDT

Update - We are continuing to work on a fix for this issue.
Apr 19, 11:02 EDT

Identified - The issue has been identified and a fix is being implemented.
Apr 19, 11:01 EDT

Investigating - We are currently investigating this issue.
Apr 19, 10:57 EDT

Apr 18, 2021

No incidents reported.

Apr 17, 2021

Hosted Exchange (HEX)

Completed - The scheduled maintenance has been completed.
Apr 17, 05:00 EDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 16, 22:00 EDT

Scheduled - Evolve IP Alert: Maintenance

Dear Valued Client,

In order to continue to provide world-class service and customer support, Evolve IP will be performing the following maintenance:

Start: Friday, April 16th, 2021 at 10:00 PM EDT
End: Saturday, April 17th, 2021 at 5:00 AM EDT
Duration: 7 hours

Purpose: In order to provide you with the best service possible, Evolve IP will be performing necessary mailbox maintenance to our Hosted Exchange platform.

Impact: While most of the maintenance is not service disruptive, you may be lost connection for short period on your Outlook client. No action needed.

Web Outlook will prompt you to close Outlook and reopen it.
There will be no disruption in mail flow for you and your organization.
If you have any questions, please contact technical support at support@evolveip.net.

Remediation: None

Required user actions: None

If you have any questions, please visit the Help Center portal at https://help.evolveip.net and submit a General Inquiry. If you have an urgent incident, please call the Evolve IP Help Center at 877.459.4347, Option 2.

Thank you for your attention and understanding.
_________________________
Evolve IP Help Center
https://help.evolveip.net
877.459.4347, Option 2
Apr 5, 15:36 EDT

Apr 16, 2021

Apr 15, 2021

No incidents reported.

Apr 14, 2021

No incidents reported.

Apr 13, 2021

No incidents reported.

Apr 12, 2021

No incidents reported.

Apr 11, 2021

Odin Portal Inaccessible

Resolved - Services have continued to function normally and this incident is being marked resolved.
Apr 11, 12:52 EDT

Monitoring - Our Engineers have addressed the incident and services have been restored. We are currently monitoring.
Apr 10, 11:15 EDT

Identified - Our Engineers have identified the cause of the incident and are currently implementing a solution. Additional information will be provided as it becomes available.
Apr 10, 10:04 EDT

Investigating - Our Engineers are actively engaged and investigating the incident and additional information will be provided as it becomes available.
Apr 10, 09:44 EDT

Apr 10, 2021

Orecx

Completed - The scheduled maintenance has been completed.
Apr 10, 03:00 EDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 9, 23:00 EDT

Scheduled - To provide you with the best service possible, Evolve IP will be performing routine network maintenance on our Call Recording Web Portal on Friday, April 9th, 2021 at 11PM EST until Saturday, April 10th, 2021 at 3AM EST.

During this time, the Call Recording Web Portal might be unavailable for a brief period. Note, the recording of calls will not be impacted during the maintenance.

If you have any questions, please contact your CTA or technical support at 610-964-8000 Option 5 or support@evolveip.net.
Mar 29, 14:34 EDT

Apr 9, 2021

Apr 8, 2021

ECS Application Incident

Postmortem - Read details
Apr 16, 16:41 EDT

Resolved - Services have continued to function normally and this incident is being marked resolved.

A Service Incident Report will be provided in the postmortem section within 5 business day including the Incident Summary, Root Cause, Resolution, and Remediation required.
Apr 8, 17:21 EDT

Update - Customers have confirmed systems are operational.
Apr 8, 14:41 EDT

Update - Services continue to functioning as normal and our Engineers will continue to monitor the system throughout the rest of the day.
Apr 8, 14:26 EDT

Monitoring - Our engineers have restored services and the systems is back online.
Apr 8, 14:14 EDT

Identified - Our engineers are taking actions that will momentarily restore effected services.
Apr 8, 13:52 EDT

Investigating - We are currently investigating this issue.
Apr 8, 13:44 EDT

Recap Portal Inaccessible

Monitoring - Our Engineers have addressed the incident and Recap is now accessible.
Apr 8, 06:57 EDT

Update - Our Engineers are actively engaged and continue investigating the Recap Portal Inaccessibility incident and additional information will be provided as it becomes available.
Apr 7, 23:04 EDT

Update - Our Engineers are actively engaged and investigating the Recap Portal Inaccessibility incident and additional information will be provided as it becomes available.
Apr 7, 18:52 EDT

Investigating - Users are unable to complete authentication when logging into Recap portal.

Call Recordings continue to be operational and stored in the database.
Apr 7, 17:28 EDT

Apr 7, 2021

Workspace (Citrix) connectivity

Resolved - We saw limited impact to a subset of customers, the services have continued to function normally and this incident is being marked resolved.
Apr 7, 15:56 EDT

Update - We are continuing to monitor for any further issues.
Apr 7, 15:56 EDT

Monitoring - At 9:00 AM Eastern, there were higher than normal connections to the load balancers that handle Workspace (Citrix) connections that were causing connectivity issues. The issue was resolved and will be monitored.
Apr 7, 11:02 EDT

Dashboard

Completed - The scheduled maintenance has been completed.
Apr 7, 02:00 EDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 6, 23:00 EDT

Scheduled - In order to provide you the best possible experience, Evolve IP will be performing maintenance on the underlying infrastructure of the Call Center Dashboard platform.
Mar 18, 16:18 EDT

Subscribe to Incident