Incidentsby IbisInfiniBand connectivity issues for GPU clusters in eu-west2
Oct 3, 02:30 UTCOct 3, 08:59 UTC
Duration
6h 28m
Impact
Minor
Root cause
Network
Nebius, 90 days
22 incidents
Affected
Compute CloudEU-WEST2 - Compute Cloud
Final update
This incident has been resolved.
Timeline
- Resolved · Oct 3, 08:59 UTC
This incident has been resolved.
- Monitoring · Oct 3, 07:44 UTC
A fix has been implemented and we are monitoring the results.
- Identified · Oct 3, 04:45 UTC
We have identified the cause of the InfiniBand connectivity issues. Our on-site team is working to resolve it. We will provide an update as soon as we have more information.
- Investigating · Oct 3, 02:30 UTC
We are investigating InfiniBand connectivity issues affecting some GPU clusters in Compute Cloud in eu-west2. Distributed training jobs on affected clusters may experience degraded interconnect performance or failures. We will provide an update as soon as we have more information.
More from Nebius
Full historyMetrics unavailable in Management Console for Monitoring in eu-west1lasted 11mProblems with power for several dozens of nodeslasted 14h 45mIssues with preempted Managed Kubernetes nodes in all regionslasted 24hCompute VM creation and Object storage are partial unavailablelasted 9mNetwork issues in eu-west2lasted 3h 12mObject storage unavailable in eu-west1lasted 0m