<?xml version="1.0" encoding="UTF-8" ?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:webfeeds="http://webfeeds.org/rss/1.0" xmlns:media="http://search.yahoo.com/mrss/">
    <channel>
        <title>Brixly - Network Status</title>
        <link>https://network.brixly.uk/rss</link>
        <description><![CDATA[Status Feed]]></description>
        <atom:link href="https://network.brixly.uk/" rel="self"></atom:link>
                                                                <language>en</language>
        <lastBuildDate>Tue, 26 Jun 2018 08:03:36 +0000</lastBuildDate>
                <item>
            <title><![CDATA[Alfa - Hardware Upgrade - Completion]]></title>
                        <link>https://network.brixly.uk/incident/34/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/34/</guid>
            <description><![CDATA[The server will be rebooted to complete the migration - this will take sites offline for a short period.

Downtime was kept within the estimated period, although delayed slightly due to the scale of the migration.

The work has been ongoing since 11pm last night, however there were some delays unfortunately caused by Cloudlinux licences not being activated immediately and some delayed responses from their support department, which delayed the migration start until 2am.

As such, the migration task overran, however didn't justify a restart of the entire process.

Sites will be online shortly, and services resumed (with the increased performance).

Please avoid contacting support / live chat whilst the process is completed.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 20 Jun 2018 10:49:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Alfa - Hardware Upgrade - Update]]></title>
                        <link>https://network.brixly.uk/incident/33/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/33/</guid>
            <description><![CDATA[The hardware upgrade is almost complete. 

To finalise the process, we will be switching the IP Addresses over, and re-configuring the network devices. As such, downtime may be intermittent.

Many thanks,

Brixly]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 20 Jun 2018 09:56:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Alfa - Hardware Upgrade]]></title>
                        <link>https://network.brixly.uk/incident/32/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/32/</guid>
            <description><![CDATA[The migration between hardware is underway - the process should take a few hours longer than expected, however, we will ensure downtime is kept to a minimum on the final switch between the machines.

Further updates will be provided here only, so please avoid raising support enquiries during this phase of the migration.

Many thanks,

Brixly L3 Team]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 20 Jun 2018 01:27:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Server Replacement]]></title>
                        <link>https://network.brixly.uk/incident/31/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/31/</guid>
            <description><![CDATA[We have worked throughout the night to build a replacement server, whereby we have replaced RAID1 disks for a RAID10 SSD array to improve the IOwait performance.

This is in progress - on completion of the account restorations, we will need to switch IP addresses therefore some indeterminacy should be expected.

UPDATE: This has now completed - the Hotel server is now running on new hardware. Instead of the anticipated 15 - 20 minutes downtime, we managed to get this to around 5 minutes total.

All sites are now online and fully operational.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Thu, 31 May 2018 03:35:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Intermittent Downtime - Hotel]]></title>
                        <link>https://network.brixly.uk/incident/30/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/30/</guid>
            <description><![CDATA[The Hotel server will be rebooted and services restarted at intermittent intervals throughout today 

We noticed an iowait spike, which appears to be caused by kswapd, whilst ram / memory is available.

This seems to be a kernel bug, however to attempt to combat this for stability we are adding more ram to the machine.

Update:

We have changed the status of this work to a major outage - we apologise for the inconvenience

Our L3 tech has been despatched to the DC to investigate the issue with the server not booting.

Service will be restored as soon as possible.

Please keep checking here for an update as opposed to raising Support enquiries / chat requests. You as clients have the same amount of information here as our staff on front line support.

Update: 

Our team have now booted the machine, and have added a custom script to temporarily resolve an issue until Cloudlinux can check Monday

This has been set to performance issue, as the server is online and mostly stable.

Update:

The server is now stable. We have had our situation prioritised by the Cloudlinux Engineers - they have made some tweaks which have helped stabilising things further from our ram increase.

Changing this to resolved.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Sat, 26 May 2018 08:54:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Scheduled Maintenance - Charlie]]></title>
                        <link>https://network.brixly.uk/incident/29/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/29/</guid>
            <description><![CDATA[Network / Uplink changes and DDoS Routing

We will be making some changes to the Charlie server in order to better prevent any further DDoS attacks on the Charlie server.

Work will be carried out at 3am, 24th May 2018 and is estimated to take approx 30 minutes.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 23 May 2018 11:09:26 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Kernel Patches / Network Patches Required - Charlie]]></title>
                        <link>https://network.brixly.uk/incident/28/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/28/</guid>
            <description><![CDATA[IMPORTANT: 

We will be running some changes via the BIOS, which will be done at 3am tomorrow morning. 

Once complete, we expect all service to be resumed.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 23 May 2018 11:07:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[DDoS Attack]]></title>
                        <link>https://network.brixly.uk/incident/27/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/27/</guid>
            <description><![CDATA[Please note that the team are working tirelessly to combat a DDoS attack on the Charlie server.

Please note connectivity will be intermittent until the mitigation is in place.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 23 May 2018 06:47:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Bravo - Status Update]]></title>
                        <link>https://network.brixly.uk/incident/25/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/25/</guid>
            <description><![CDATA[The server is back online and all services restored.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 30 Apr 2018 18:58:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Bravo - Boot Update]]></title>
                        <link>https://network.brixly.uk/incident/24/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/24/</guid>
            <description><![CDATA[The server is in part back online - we are just running some final changes to bring the server to a stable position.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 30 Apr 2018 18:15:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Boot Issue - Bravo]]></title>
                        <link>https://network.brixly.uk/incident/23/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/23/</guid>
            <description><![CDATA[Please note that following a CPU / process issue on the Bravo server, the machine was rebooted. On reboot, the server has entered maintenance mode. 

The team are working to resolve this as the highest priority.

Services will be resumed as soon as possible.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 30 Apr 2018 17:53:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Disk Issues - Alfa]]></title>
                        <link>https://network.brixly.uk/incident/22/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/22/</guid>
            <description><![CDATA[The server will be rebooting for around 10 minutes due to some required disk / BIOS changes.

** Update - The server reboot has completed, and the service is now fully operational **]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 30 Apr 2018 11:54:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[MySQL / Golf - Resolved]]></title>
                        <link>https://network.brixly.uk/incident/21/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/21/</guid>
            <description><![CDATA[The issue with InnoDB tables has now been resolved]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Thu, 26 Apr 2018 01:11:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[MySQL Issues - Golf]]></title>
                        <link>https://network.brixly.uk/incident/20/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/20/</guid>
            <description><![CDATA[The MySQL service is currently up, but isn't responding to requests.

We are investigating this currently and will resume services as soon as possible.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 25 Apr 2018 23:03:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Bravo - Update]]></title>
                        <link>https://network.brixly.uk/incident/19/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/19/</guid>
            <description><![CDATA[The server has been restored to a fully functioning state.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 25 Apr 2018 10:30:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[BRAVO - Current connectivity issues]]></title>
                        <link>https://network.brixly.uk/incident/18/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/18/</guid>
            <description><![CDATA[Currently we are experiencing connectivity issues - the team are investigating.

This issue is currently being caused by a DDoS attack from China.

We have temporarily placed a block on all connections coming from China.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Wed, 25 Apr 2018 09:35:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Urgent Reboot - Bravo]]></title>
                        <link>https://network.brixly.uk/incident/14/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/14/</guid>
            <description><![CDATA[The Bravo server is currently being rebooted as part of emergency maintenance. Service will be restored within a few minutes.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Tue, 03 Apr 2018 10:05:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Bravo - Reboot Complete - Remounting /home3]]></title>
                        <link>https://network.brixly.uk/incident/15/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/15/</guid>
            <description><![CDATA[We have rebooted the bravo server successfully, the service is now online and performing as normal.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Tue, 03 Apr 2018 09:44:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Foxtrot - Migration Complete]]></title>
                        <link>https://network.brixly.uk/incident/13/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/13/</guid>
            <description><![CDATA[Thanks for your patience during the migration process. We have now completed the move from foxtrot to bravo.cloudns.io

If you were using our nameservers, or custom nameservers then you would already be pointing to the new IP address.

If you are using Cloudflare please update your IP to the one displayed in whm -> List Accounts

I'd you have any issues with a particular site following the move then please raise a support ticket so can check in detail for you.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Tue, 27 Mar 2018 01:54:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Foxtrot - Update]]></title>
                        <link>https://network.brixly.uk/incident/12/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/12/</guid>
            <description><![CDATA[We are pleased to confirm the foxtrot server is back online. We will however be continuing to move the contents of this server to alternative hardware - as such, the previously mentioned details regarding nameserver updates still apply.

The migration process is ongoing, however the server is online and serving content for the duration. This will vastly speed up the migration progress.

Please note that contents of some sites may be partial, or missing data until the process has completed.

Many thanks for your patience.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 26 Mar 2018 20:06:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Foxtrot - Restore in Progress]]></title>
                        <link>https://network.brixly.uk/incident/11/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/11/</guid>
            <description><![CDATA[We have began migration from the foxtrot.cloudns.io server to its replacement - an email notification has been sent to all clients affected by the outage with more information.

Please continue to check back here for updates.

As mentioned on the email, migration will be done in two parts - first, the account data (this is to ensure mail services are restored first of all) - then site data secondly. 

Whilst we don't have an ETA, we do expect the process will take a few hours to complete due to the amount of data required to be restored.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 26 Mar 2018 18:23:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Foxtrot - Update]]></title>
                        <link>https://network.brixly.uk/incident/10/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/10/</guid>
            <description><![CDATA[Apologies for the delay in getting the server back online - there is an issue in booting the machine up which appears to be related to the storage layer / SAN. Of course, we are working on this as high priority.

The team are working on a recovery process currently, whereby all accounts MAY be restored to a separate physical machine. We strongly encourage you set the nameservers for any domains on the foxtrot.cloudns.io server to point to our own nameservers (ns1.cloudns.io / ns2.cloudns.io) or your own custom nameservers resolving to those same IP addresses - this will allow us to migrate accounts fairly easily from our end.

Further updates will be provided here.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 26 Mar 2018 16:40:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Foxtrot - Outage - Update]]></title>
                        <link>https://network.brixly.uk/incident/9/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/9/</guid>
            <description><![CDATA[We apologise for the delays in getting the server back online - there seems to be an issue with the reboot, which we are working on currently. 

The team would appreciate that tickets were kept to a minimum during this time and questions regarding the downtime will be referred here.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 26 Mar 2018 15:01:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Outage - Foxtrot]]></title>
                        <link>https://network.brixly.uk/incident/8/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/8/</guid>
            <description><![CDATA[The foxtrot server became unavailable due to a sudden spike in DDoS traffic - this is being mitigated currently and the service will be resumed as soon as possible.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Mon, 26 Mar 2018 14:15:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Upgrades - Zulu - Complete]]></title>
                        <link>https://network.brixly.uk/incident/7/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/7/</guid>
            <description><![CDATA[The upgrade process has now completed.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Thu, 22 Mar 2018 15:18:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Upgrades - Zulu]]></title>
                        <link>https://network.brixly.uk/incident/6/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/6/</guid>
            <description><![CDATA[We are currently running some upgrades on the Zulu server - whilst this is ongoing, you may notice some intermittency in site connectivity.

The process should be complete in around 30 minutes.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Thu, 22 Mar 2018 15:12:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Disk issue -- Resolved]]></title>
                        <link>https://network.brixly.uk/incident/5/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/5/</guid>
            <description><![CDATA[The issue was resolved with a reboot. The system is now operating normally.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Sat, 17 Mar 2018 15:47:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Disk Issues]]></title>
                        <link>https://network.brixly.uk/incident/4/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/4/</guid>
            <description><![CDATA[The golf server has had an IO spike caused by a mistake within a script on our end. We are rebooting the machine for a quick resolution.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Sat, 17 Mar 2018 15:36:00 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Attack mitigated - network stabalised]]></title>
                        <link>https://network.brixly.uk/incident/2/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/2/</guid>
            <description><![CDATA[The previous reported attack has now been mitigated]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Thu, 08 Mar 2018 02:24:21 +0000</pubDate>
                                                                                                        </item>
                <item>
            <title><![CDATA[Attack mitigation / network stabalisation]]></title>
                        <link>https://network.brixly.uk/incident/1/</link>
            <guid isPermaLink="true">https://network.brixly.uk/incident/1/</guid>
            <description><![CDATA[There seems to be some intermittency with our Albany / USA - cPanel server. From analysis of the logs, it appears to relate to a select few accounts, which have now been suspended. 

We will continue to monitor this.]]></description>
                        <dc:creator xmlns:dc="http://purl.org/dc/elements/1.1/">Brixly - Network Status</dc:creator>
            <pubDate>Thu, 08 Mar 2018 01:13:00 +0000</pubDate>
                                                                                                        </item>
            </channel>
</rss>
