Incidents | HYPRR

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Wed, 08 Apr 2026 08:30:02 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Website (hyprr.space) recovered

Wed, 08 Apr 2026 07:49:44 +0000

Website (hyprr.space) recovered

Lomiri API (Minecraft) recovered

Wed, 08 Apr 2026 07:48:49 +0000

Lomiri API (Minecraft) recovered

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Wed, 08 Apr 2026 04:36:40 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Tue, 07 Apr 2026 20:00:02 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-2 [Xeon X5690, DDR3] recovered

Tue, 07 Apr 2026 20:00:02 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Tue, 07 Apr 2026 20:00:02 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Tue, 07 Apr 2026 19:52:40 +0000

LUCID-2 [Xeon X5690, DDR3] went down

LUCID-1 [Xeon X5690, DDR3] went down

Tue, 07 Apr 2026 19:52:38 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Tue, 07 Apr 2026 19:51:32 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-2 [Xeon X5690, DDR3] recovered

Tue, 07 Apr 2026 19:40:02 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Tue, 07 Apr 2026 19:40:02 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Tue, 07 Apr 2026 19:40:01 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Tue, 07 Apr 2026 19:37:39 +0000

LUCID-2 [Xeon X5690, DDR3] went down

LUCID-1 [Xeon X5690, DDR3] went down

Tue, 07 Apr 2026 19:37:38 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Tue, 07 Apr 2026 19:36:37 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-2 [Xeon X5690, DDR3] recovered

Tue, 07 Apr 2026 19:20:02 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Tue, 07 Apr 2026 19:20:01 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Tue, 07 Apr 2026 19:20:01 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Tue, 07 Apr 2026 19:12:39 +0000

LUCID-2 [Xeon X5690, DDR3] went down

LUCID-1 [Xeon X5690, DDR3] went down

Tue, 07 Apr 2026 19:12:38 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Tue, 07 Apr 2026 19:11:32 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Lomiri API (Minecraft) went down

Tue, 07 Apr 2026 18:39:34 +0000

Lomiri API (Minecraft) went down

Website (hyprr.space) went down

Tue, 07 Apr 2026 18:38:36 +0000

Website (hyprr.space) went down

Lomiri API (Minecraft) recovered

Tue, 07 Apr 2026 17:23:41 +0000

Lomiri API (Minecraft) recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Tue, 07 Apr 2026 17:22:19 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] went down

Tue, 07 Apr 2026 17:17:41 +0000

LUCID-1 [Xeon X5690, DDR3] went down

Lomiri API (Minecraft) went down

Tue, 07 Apr 2026 17:09:40 +0000

Lomiri API (Minecraft) went down

LUCID-2 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 18:30:03 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 18:30:02 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Sun, 05 Apr 2026 18:30:02 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 18:07:41 +0000

LUCID-2 [Xeon X5690, DDR3] went down

LUCID-1 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 18:07:40 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Sun, 05 Apr 2026 18:06:37 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-2 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 16:20:02 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 16:20:01 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Sun, 05 Apr 2026 16:20:01 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 16:17:48 +0000

LUCID-2 [Xeon X5690, DDR3] went down

LUCID-1 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 16:17:46 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Sun, 05 Apr 2026 16:16:42 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-1 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 15:40:07 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Sun, 05 Apr 2026 15:40:07 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-1 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 15:37:46 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Sun, 05 Apr 2026 15:36:42 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-1 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 14:25:04 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Sun, 05 Apr 2026 14:25:02 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-2 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 14:22:14 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 14:12:44 +0000

LUCID-2 [Xeon X5690, DDR3] went down

LUCID-1 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 14:12:41 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Sun, 05 Apr 2026 14:11:37 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-1 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 14:00:01 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Sun, 05 Apr 2026 13:55:12 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-2 [Xeon X5690, DDR3] recovered

Sun, 05 Apr 2026 13:51:25 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 13:47:37 +0000

LUCID-2 [Xeon X5690, DDR3] went down

LUCID-1 [Xeon X5690, DDR3] went down

Sun, 05 Apr 2026 13:47:35 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Sun, 05 Apr 2026 13:46:52 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Lomiri API (Minecraft) recovered

Wed, 01 Apr 2026 07:53:40 +0000

Lomiri API (Minecraft) recovered

Website (hyprr.space) recovered

Wed, 01 Apr 2026 07:50:08 +0000

Website (hyprr.space) recovered

LUXOR-1 [Ryzen 7 9700X, DDR5] recovered

Wed, 01 Apr 2026 07:50:02 +0000

LUXOR-1 [Ryzen 7 9700X, DDR5] recovered

LUXOR-1 [Ryzen 7 9700X, DDR5] went down

Wed, 01 Apr 2026 00:46:37 +0000

LUXOR-1 [Ryzen 7 9700X, DDR5] went down

Website (hyprr.space) went down

Wed, 01 Apr 2026 00:41:37 +0000

Website (hyprr.space) went down

Lomiri API (Minecraft) went down

Wed, 01 Apr 2026 00:39:37 +0000

Lomiri API (Minecraft) went down

Lomiri API (Minecraft) recovered

Sun, 29 Mar 2026 13:08:42 +0000

Lomiri API (Minecraft) recovered

Lomiri API (Minecraft) went down

Sun, 29 Mar 2026 12:58:47 +0000

Lomiri API (Minecraft) went down

Lomiri API (Minecraft) recovered

Sun, 29 Mar 2026 11:13:49 +0000

Lomiri API (Minecraft) recovered

Website (hyprr.space) recovered

Sun, 29 Mar 2026 11:13:47 +0000

Website (hyprr.space) recovered

Lomiri API (Minecraft) went down

Sun, 29 Mar 2026 11:09:35 +0000

Lomiri API (Minecraft) went down

Website (hyprr.space) went down

Sun, 29 Mar 2026 11:08:36 +0000

Website (hyprr.space) went down

Lomiri API (Minecraft) recovered

Wed, 25 Mar 2026 19:13:44 +0000

Lomiri API (Minecraft) recovered

Website (hyprr.space) recovered

Wed, 25 Mar 2026 18:46:37 +0000

Website (hyprr.space) recovered

Lomiri API (Minecraft) went down

Wed, 25 Mar 2026 18:34:34 +0000

Lomiri API (Minecraft) went down

Website (hyprr.space) went down

Wed, 25 Mar 2026 18:32:37 +0000

Website (hyprr.space) went down

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Sat, 21 Mar 2026 12:20:05 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-2 [Xeon X5690, DDR3] recovered

Sat, 21 Mar 2026 12:20:02 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Sat, 21 Mar 2026 12:20:02 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Sat, 21 Mar 2026 02:17:33 +0000

LUCID-2 [Xeon X5690, DDR3] went down

LUCID-1 [Xeon X5690, DDR3] went down

Sat, 21 Mar 2026 02:17:32 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Sat, 21 Mar 2026 02:16:37 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-2 [Xeon X5690, DDR3] recovered

Sun, 08 Mar 2026 15:30:03 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-2 [Xeon X5690, DDR3] went down

Wed, 04 Mar 2026 21:27:33 +0000

LUCID-2 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Tue, 03 Mar 2026 21:30:03 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-2 [Xeon X5690, DDR3] recovered

Tue, 03 Mar 2026 21:30:02 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Tue, 03 Mar 2026 21:30:02 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] went down

Tue, 03 Mar 2026 21:12:42 +0000

LUCID-1 [Xeon X5690, DDR3] went down

LUCID-2 [Xeon X5690, DDR3] went down

Tue, 03 Mar 2026 21:12:32 +0000

LUCID-2 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Tue, 03 Mar 2026 21:11:38 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUXOR-1 [Ryzen 7 9700X, DDR5] recovered

Tue, 03 Mar 2026 14:50:05 +0000

LUXOR-1 [Ryzen 7 9700X, DDR5] recovered

Lomiri API (Minecraft) recovered

Tue, 03 Mar 2026 14:48:41 +0000

Lomiri API (Minecraft) recovered

LUXOR-1 [Ryzen 7 9700X, DDR5] went down

Tue, 03 Mar 2026 13:56:47 +0000

LUXOR-1 [Ryzen 7 9700X, DDR5] went down

Lomiri API (Minecraft) went down

Tue, 03 Mar 2026 13:54:37 +0000

Lomiri API (Minecraft) went down

LUXOR-1 [Ryzen 7 9700X, DDR5] recovered

Mon, 02 Mar 2026 21:20:05 +0000

LUXOR-1 [Ryzen 7 9700X, DDR5] recovered

LUXOR-1 [Ryzen 7 9700X, DDR5] went down

Mon, 02 Mar 2026 20:36:51 +0000

LUXOR-1 [Ryzen 7 9700X, DDR5] went down

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Wed, 25 Feb 2026 11:20:02 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Wed, 25 Feb 2026 11:19:58 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Wed, 25 Feb 2026 10:56:45 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-1 [Xeon X5690, DDR3] went down

Wed, 25 Feb 2026 10:52:34 +0000

LUCID-1 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Wed, 25 Feb 2026 10:40:02 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Wed, 25 Feb 2026 10:39:58 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

LUCID-2 [Xeon X5690, DDR3] recovered

Wed, 25 Feb 2026 10:30:16 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] went down

Wed, 25 Feb 2026 10:07:42 +0000

LUCID-1 [Xeon X5690, DDR3] went down

LUCID-2 [Xeon X5690, DDR3] went down

Wed, 25 Feb 2026 10:07:29 +0000

LUCID-2 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Wed, 25 Feb 2026 10:06:44 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

LUCID-2 [Xeon X5690, DDR3] recovered

Wed, 18 Feb 2026 09:45:27 +0000

LUCID-2 [Xeon X5690, DDR3] recovered

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

Wed, 18 Feb 2026 09:45:27 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] recovered

LUCID-1 [Xeon X5690, DDR3] recovered

Wed, 18 Feb 2026 09:44:54 +0000

LUCID-1 [Xeon X5690, DDR3] recovered

LUCID-1 [Xeon X5690, DDR3] went down

Wed, 18 Feb 2026 06:47:27 +0000

LUCID-1 [Xeon X5690, DDR3] went down

LUCID-2 [Xeon X5690, DDR3] went down

Wed, 18 Feb 2026 06:47:18 +0000

LUCID-2 [Xeon X5690, DDR3] went down

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Wed, 18 Feb 2026 06:46:34 +0000

DELTA-1 [Ryzen 7 5800X, DDR4] went down

Lomiri API (Minecraft) recovered

Wed, 11 Feb 2026 20:03:44 +0000

Lomiri API (Minecraft) recovered

Lomiri API (Minecraft) went down

Wed, 11 Feb 2026 15:53:47 +0000

Lomiri API (Minecraft) went down

Lomiri API (Minecraft) recovered

Tue, 10 Feb 2026 16:04:08 +0000

Lomiri API (Minecraft) recovered

Lomiri API (Minecraft) went down

Tue, 10 Feb 2026 15:28:43 +0000

Lomiri API (Minecraft) went down

Работа на сети в Германии

Thu, 15 Jan 2026 20:00:04 -0000

Работа на сети в Германии

Обновление роутеров и алгоритмов шифрования трафика

Tue, 16 Dec 2025 07:30:59 -0000

Последние дни поступали жалобы о низкой скорости соединения. Иногда Speedtest показывал входящую скорость 5 мбит/с, что очень мало. Мы проведем работы на сети для поиска и исправления проблем со скоростью

Обновление оборудования и сети в Московской локации

Fri, 05 Sep 2025 08:35:00 -0000

Maintenance completed

Обновление оборудования и сети в Московской локации

Fri, 05 Sep 2025 08:00:00 -0000

• Увеличение объема ОЗУ на ноде PORTAL-1 • Увеличение объема ОЗУ на ноде DELTA-1 • Увеличение пропускной способности роутера MSK-ROUTER0 с 1 Гбит/с до 10 Гбит/с

Задержка смены IP для DELTA-1, неожиданный даунтайм

Mon, 04 Aug 2025 09:28:00 -0000

DELTA-1 получила новый IP, компенсация - 6 дней за ровно 12 часов недоступности. Вдобавок к этому это последняя работа на сети в Москве

Задержка смены IP для DELTA-1, неожиданный даунтайм

Sun, 03 Aug 2025 23:25:00 -0000

Старый IP мы отпустили, а новую подсеть нам задержали

Деградация K8s кластера

Wed, 23 Jul 2025 22:12:00 -0000

Я НЕ знаю что произошло и почему все работает сейчас, причем так как и всегда - без единого намека на инцидент, заставивший стафф поседеть. Была ли проблема в сети, в K8s, в РКН, в убогости птеродактиля или в чем либо еще - я без понятия, может быть было все и сразу. В любом случае оно работает, по SLA компенсации не будет, так как этот инцидент не затрагивал сами ноды. И у HYPRR не будет какой либо нормальной SLA пока такая хрень продолжается - мы не знаем чья это вина, мы не знаем почему что-либо происходит. РКН проводит блокировки и тесты когда и где хочет. Баннер о деградации сервисов Cloudflare (вообще, не только в РФ) появляется каждую неделю. Мир разваливается. Так что по крайней мере я не знаю как считать SLA, если даже не понятно что влияет на него. Зато есть моды на капибару 😍

Деградация K8s кластера

Wed, 23 Jul 2025 15:00:00 -0000

Где-то между 15:00 мск и 18:00 мск происходил такой ужас, что админ пережил экзистенциальный кризис, пару клинических смертей, отвал Pterodactyl на ровном месте (ни логов, ни ошибок в stderr, просто 503) и тепловую смерть вселенной. На этом админ покидает вас и прод, я так больше не могу

Деградация K8s кластера

Wed, 23 Jul 2025 13:00:00 -0000

HALO GAYS TODAY WE HAVE TOP 5 CRASHOUT REASONS: Numero cinco: Got an error reading communication packets (MariaDB) Numero cuatro: Entry for is not found in ARP table Numero tres: Fatal error: can't open the AOF manifest file appendonlydir/appendonly.aof.manifest for reading: Input/output error Numero dos: No healthy replicas Numero uno: Reading registry-1.docker.io: i/o timeout

Деградация K8s кластера

Wed, 23 Jul 2025 12:30:00 -0000

Reasonable crashout: машины могут подключиться к интернету, но не к DOCKER HUB. Симптомы ркновские - http работает и просит редирект, https уходит в таймаут на SSL рукопожатии. У админа тряска и желание убивать

Деградация K8s кластера

Wed, 23 Jul 2025 12:00:00 -0000

Том восстановить не удалось. Он был пересоздан и проверен на целостность. Начат запуск сервисов

Деградация K8s кластера

Wed, 23 Jul 2025 11:40:00 -0000

Перезагружена конфигурация на всех роутерах, сброшен conntrack, связность восстановлена. Продолжаем изучать проблему с томами Longhorn

Деградация K8s кластера

Wed, 23 Jul 2025 11:10:00 -0000

Наблюдаются неполадки с SDN сетью в Москве. Потенциально это и стало причиной рассинхронизации и повреждения томов. Изучаются проблемы и доступность нод

Деградация K8s кластера

Wed, 23 Jul 2025 10:50:00 -0000

Все сервисы отключены, здоровые реплики найдены. Сделан бэкап. Начинаем попытку восстановления

Деградация K8s кластера

Wed, 23 Jul 2025 10:30:00 -0000

Наблюдается повреждение тома Longhorn (ошибка i/o). Начат поиск здоровых и целых реплик

Деградация K8s кластера

Wed, 23 Jul 2025 10:05:00 -0000

Наблюдается деградация API панели, выясняются обстоятельства