14 West Product Status

Thoughtspot Login Issues

Identified - We have identified the login issues were due to a post Thoughtspot upgrade SAML account migration. While Thoughtspot is still evaluating the exact cause of this failure, we have rolled back to our original configuration. All users should be able to access Thoughtspot again through OneLogin.

We will keep this incident open while Thoughtspot determines the best path forward for our SAML account migration. Thoughtspot should continue working as expected.
Feb 27, 2025 - 19:59 EST

Investigating - We're currently investigating user login issues with Thoughtspot. Some users are experiencing errors when attempting to login through OneLogin.

If you are experiencing issues and have any reporting needs during this time, please access Qlik Sense through OneLogin.

All data processing and presentation is running normally and as expected. This is just a Thoughtspot access issue at the moment.
Feb 27, 2025 - 17:02 EST

ADVISORY - Horizon Degraded Performance

Investigating - Is the ability to take or process orders affected?
No

Are Customers able to access their products?
Yes

The Issue
VMWare Horizon users may be experiencing time-outs or authentication failures.

The Impact
Those who use VMWare Horizon to remotely access their workstations or streaming applications may affected.

Workaround
In office access to workstations are not affected. An alternative method of remotely accessing workstations is available via VPN. Please submit a Jira Service Desk request for I.T. to assist with setting up VPN access to your workstation.

Next Update
2 hours or as available.

For updates in real-time, you can check here at https://14west.statuspage.io/.

Thank you,

14West Technologies Support
Jan 27, 2025 - 11:00 EST

Uptime over the past 90 days. View historical uptime.

Advantage Operational

90 days ago

100.0 % uptime

Today

WesTech Marketing Cloud Operational

90 days ago

99.99 % uptime

Today

Blueshift Operational

90 days ago

100.0 % uptime

Today

IRIS Operational

90 days ago

92.32 % uptime

Today

Platform Integration Engine (PIE) Operational

90 days ago

100.0 % uptime

Today

PIE Job API Operational

90 days ago

100.0 % uptime

Today

ADV Rest Adapter Operational

90 days ago

100.0 % uptime

Today

Hasura REST API Operational

90 days ago

100.0 % uptime

Today

Signup App Operational

90 days ago

100.0 % uptime

Today

Data & Analytics Operational

90 days ago

100.0 % uptime

Today

Portfolio Tracker Operational

Deliverability Operational

90 days ago

100.0 % uptime

Today

IT Operational

90 days ago

100.0 % uptime

Today

IT | General Operations Operational

90 days ago

100.0 % uptime

Today

OpenShift Cluster | APJ1 Operational

90 days ago

100.0 % uptime

Today

OpenShift Cluster | C3-BALT Operational

90 days ago

100.0 % uptime

Today

OpenShift Cluster | C4-AWS-DEV Operational

90 days ago

100.0 % uptime

Today

OpenShift Cluster | C6-OSD Operational

90 days ago

100.0 % uptime

Today

OpenShift Cluster | C7-OSD Operational

90 days ago

100.0 % uptime

Today

OpenShift Cluster | C3 "AWS3-PRD" Operational

90 days ago

100.0 % uptime

Today

OpenShift Cluster | BALT2-PRD Operational

90 days ago

100.0 % uptime

Today

OneLogin Operational

90 days ago

100.0 % uptime

Today

Atlassian Products Operational

90 days ago

100.0 % uptime

Today

OneTrust Operational

90 days ago

100.0 % uptime

Today

FinTech Degraded Performance

90 days ago

100.0 % uptime

Today

PayGate Operational

90 days ago

100.0 % uptime

Today

OneSource Operational

90 days ago

100.0 % uptime

Today

Spreedly Degraded Performance

90 days ago

100.0 % uptime

Today

Thoughtspot Operational

90 days ago

100.0 % uptime

Today

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

Thoughtspot Answer and Liveboard Clean-up Mar 14, 2025 13:00-14:00 EDT

Update - We will be extending time for users to remove tags until 1pm on Friday March 14. Please reach out with any questions.
Feb 27, 2025 - 19:49 EST

Update - We will be undergoing scheduled maintenance during this time.
Feb 26, 2025 - 16:34 EST

Scheduled - On February 28 at 1pm, any Answers and Liveboards that have not been viewed or edited in over 6 months will be permanently removed from Thoughtspot in an effort to reduce our footprint. These Answers and Liveboards have all been marked with "clean-up" tags. We do not anticipate any downtime with Thoughtspot during this process.

If you would like to retain any Answers and Liveboards marked for "clean-up", you will need to access Thoughspot ahead of February 28 and remove those "clean-up" tags. For instructions on how to do this, you can watch the loom recording below.

https://www.loom.com/share/8800c32f19c944e6970468692550949b?sid=7f46d967-9123-4a6e-86a7-6895965cb12f

If you have any questions or concerns, please submit a ticket to Data & Analytics at the link below:
https://14west.atlassian.net/servicedesk/customer/portal/14/group/53/create/179
Feb 06, 2025 - 17:14 EST

Past Incidents

Feb 27, 2025

ADVISORY - Slack Degraded Performance

Resolved - Slack has resolved the issues with authenticating via SSO.
Feb 27, 09:05 EST

Investigating - Is the ability to take or process orders affected?
No

Are Customers able to access their products?
Yes

The Issue
Slack is currently experiencing a problem with logging in via SSO (OneLogin).

The Impact
Slack continues to be operation for users with existing connections, but logins to new sessions may not be possible. Both the web and desktop applications appear to be affected.

Workaround
Some users may be completely locked out of Slack, so if someone is not responding your Slack messages, you may need to contact them via Teams or Email.

Next Update
When available

For updates in real-time, you can check here at https://14west.statuspage.io/.

Thank you,

14West Technologies Support
Feb 26, 11:52 EST

Feb 26, 2025

Feb 25, 2025

No incidents reported.

Feb 24, 2025

No incidents reported.

Feb 23, 2025

Resource Upgrade to Physical Advantage Servers

Completed - The scheduled maintenance has been completed.
Feb 23, 10:00 EST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Feb 23, 08:00 EST

Scheduled - The Change
The Platform Engineering team will install additional RAM on the physical hardware that runs our Advantage production database servers.

Why are we making this change?
The purpose of this change is to improve the long-term performance of our Advantage services by providing ample room for usage growth.

The Impact
No downtime is expected for customers and end-users of services which interface with Advantage.
- Internal teams have coordinated changes to ensure continuous uptime of the PIE API services.

The Remediation Plan
A thorough, step-by-step plan has been drafted by the Platform Engineering team to ensure a smooth upgrade.
Feb 23, 07:45 EST

Feb 22, 2025

No incidents reported.

Feb 21, 2025

No incidents reported.

Feb 20, 2025

No incidents reported.

Feb 19, 2025

ADVISORY - IRIS Issue – Editing Creatives/Offers

Resolved - Hey everyone,
IRIS is now back working as expected—you can edit a Creative and Offer once more.
The issue was caused by a stopped service, which we have restarted.
Let’s call this one resolved. Thanks for your patience!
Feb 19, 09:39 EST

Investigating - Hey everyone,

We are currently experiencing an issue in IRIS. When attempting to edit a Creative or Offer, the page returns a 404 error.

Customer-facing pages remain unaffected.

Our team is actively investigating the issue, and we will provide an update within the next 90 minutes.

Thanks for your patience!
The IRIS team.
Feb 19, 09:30 EST

Feb 18, 2025

No incidents reported.

Feb 17, 2025

No incidents reported.

Feb 16, 2025

No incidents reported.

Feb 15, 2025

F5 BIGIP Code Upgrade CORP - ver 15.x to 16.x

Completed - The scheduled maintenance has been completed.
Feb 15, 17:00 EST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Feb 15, 14:00 EST

Scheduled - The Change
Upgrading the F5 BIGIP load-balancer code from version 15.1.10.2 to 16.1.5.1 in CORP (Prod)

Why are we making this change?
To keep the code as updated as possible to a supported version.

The Impact:
There is no anticipated impact as the hardware configuration is setup as a highly available fail-over cluster.

- What systems will this affect, and will they be available. If not, what is the time-frame for the outage?

All Prod systems behind the F5 BIG-IP On-Prem CORP load-balancer:
IRIS - PROD
Advantage - PROD
Qlik - PROD
Horizon View -PROD

*All systems will remain on-line and available during this maintenance*

- Will it affect the ability to take an order? - No
- Will it affect the ability of a customer to access content? - No
- Will it affect our ability to send email? - No

The Remediation Plan:
Code will be upgraded on the standby appliance first and then a failover operation will be tested. If issues are identified, the appliance can be reverted by booting from the previous code partition. If no issues are identified, the code upgrade will proceed on the remaining appliance.

NOTE: If there are any noticeable changes in performance or "weirdness" after the CORP code upgrade, please reach out to IT for investigation.
Feb 12, 13:10 EST

Feb 14, 2025

No incidents reported.

Feb 13, 2025

No incidents reported.

Related