Network Survey ReportRead-only diagnosticNo configuration changed

White Sand Luxury Villas & Spa

How the property's UniFi network is built, and everything a two-day live diagnostic found wrong with it — with exact switches and ports named for the on-site team.

SiteZanzibar, Tanzania
GatewayUDM Pro Max · 192.168.1.1
ConsoleZanzibarWhiteSandLuxuryVillas
Devices~190 (switches + APs)
Surveyed10–11 Jul 2026

01Where things stand

Two days of read-only testing against the gateway, its controller database, every switch, and every access point on the property — including live packet capture directly on the gateway's own bridges. Re-prioritized around impact: the biggest, most active problem comes first.

Broadcast storm

Live, network-wide, right now

1.36M broadcast/multicast packets in 60s on the Management LAN — a likely physical L2 loop near the gateway itself. No loop protection currently active to contain it.

Switch Pro V8

Highest single-switch priority — guest villas

Aggregation point for ~30 downstream switches across villas V1–V10. Worst of a fleet-wide elevated-CPU pattern (likely the storm), plus one AP not drawing power — wiring confirmed clean.

Middlestaff WallBOX

Failing right now

211 offline/online cycles in 24 hours — roughly once every 7 minutes. Staff-area impact only, ranked below Pro V8.

Core uplink

Flapping, worsening

SFP trunk to the switch fabric destabilizing on a shrinking cycle (7d → 4d → 2d).

WAN1 (fiber)

Two long outages

11.6 hrs and 22.1 hrs down this past week — an ISP conversation, not a cabling job.

Cabling

One clear fault + drift

One port confirmed at 10 Mbps; two switches with persistently jittery links.

Bufferbloat & conntrack

Ruled out

Latency doesn't rise under load; connection table at 1.3% of capacity.

54 of 60 switches

Stable across every test

Consistent sub-millisecond response across four independent sweeps, 24 hours apart.

Access points

5 down, 24 on bad cabling

65 of 94 fully healthy; most AP-side issues trace back to switch ports, not the radios themselves.


02How the network is built

One gateway, six routed VLANs, and roughly 190 switches and access points carrying every villa, department, and back-of-house function on the property.

Internet & routing

The property runs dual-WAN with automatic failover. WAN1, the primary link, is fiber from Liquid Intelligent Technologies (gateway 154.127.0.158, static route, metric 1). WAN2 is a Starlink satellite backup on CGNAT (metric 200), which only a handful of specific devices are policy-routed onto directly. Recent usage over the sampled window was roughly 679 GB (≈572 GB down, 106 GB up).

VLANs

NetworkVLANSubnetLeasesRole
Management LAN1192.168.0.0/23163 / 379Infrastructure — switches & APs, spans .0.x and .1.x
Guest LAN1010.10.0.0/20289 / 4069Guest Wi-Fi, ~165 concurrent clients
Senior VLAN2010.20.0.0/22138 / 1007Senior staff + ops (printers, fingerprint clocks, Biotime)
MiddleStaff VLAN4010.40.0.0/22172 / 1007Middle staff
ZKP LAN3010.30.0.0/2419 / 249ZanzibarKiteParadise kitesurf school
TV VLAN11192.168.11.0/241 / 241TVs / IPTV
WireGuard VPN192.168.5.0/24Remote admin access

Wireless

SSIDNetworkClientsSecurity
WhiteSandVillasGuest LAN~165WPA2
WS-SeniorSenior VLAN~105WPA2
WS-MiddleMiddleStaff VLAN~26WPA2
ZanzibarKiteParadiseZKP LAN~10WPA2
WS-OperationsSenior VLAN~6WPA2
WS-TVTV VLANWPA2
WS-TestSenior VLANWPA3

Topology

WAN1 · FIBER WAN2 · STARLINK UDM Pro Max 192.168.1.1 eth9 · SFP flapping ⚠ switch0 fabric br0 mgmt br10 guest br11 tv br20 senior br30 kite br40 staff

All six VLANs ride the same physical uplink (§07). WAN1 itself has also had two long outages this week (§08).

Hardware inventory

Sampled 99 of ~190 adopted devices: roughly 86 online, ~12 offline (≈12%, a common baseline rather than a fresh alarm). Access points range from legacy WiFi-5 hardware (U6 Lite, AC Pro, AC Lite, UAP-LR, AC Mesh Pro) still in the majority, through to a newer WiFi-7 rollout (U7 Lite, U7 Pro Max, U7 Pro Wall, U7 Outdoor). Switches are mostly US-8-60W, US-8, and USW Flex/Lite/Pro models, named by location — one switch and one-plus AP per numbered villa (V3–V23), plus dedicated switches for CCTV cameras and the main gate.


03Full device topology

Every switch and access point on the property, laid out by actual uplink relationships pulled from the controller — not a schematic. Hover or tab to any node for its IP, model, and current health.

Gateway Switch — healthy Access point Intermittent jitter Persistent jitter / cable fault Down / chronic failure

155 of ~190 devices resolved to a parent uplink at export time; a handful whose immediate parent wasn't captured are attached directly to the gateway for display. Layout is a radial tree (angle = position among siblings, distance from center = hop count from the gateway) — not a physical floor plan.


04Live finding: a broadcast storm on the Management LAN

A direct packet capture from the gateway's own bridge interfaces — the first genuinely L2-adjacent capture in this whole survey — caught this happening in real time. Likely explanation for much of the network-wide "shared cause" jitter seen elsewhere in this report.

What was captured

A 60-second capture on the Management LAN bridge, filtered to broadcast/multicast/STP traffic only (no ordinary unicast counted), caught 1,362,651 packets — roughly 22,700 per second — with a further 14,377 dropped because the capture itself couldn't keep up. That's not background noise; that's a storm, happening right now.

Two devices, effectively the whole storm — and both trace to the same switch

IPMACHostnameShare of trafficSwitch port
192.168.0.630:1f:9a:74:e8:80"tdch"~51%Switch TVs ServerRoom, port 5 (GbE)
192.168.1.720:25:01:22:13:13none~49%Switch TVs ServerRoom, port 8 (GbE)

Correction from an earlier pass of this report: both devices were initially thought to be physically at or near the UDM Pro Max itself, based on being learned on the gateway's own switch0.1 interface. The controller's client-detail UI gives a more precise answer: both are attached to Switch TVs ServerRoom (192.168.1.233) — port 5 and port 8 respectively, both negotiated at gigabit. That earlier "near the gateway" read was wrong; the loop is physically at this one switch, not the gateway itself.

Two client ports on the same physical switch, both flooding broadcast/multicast at a near-even ~50/50 split, is the textbook signature of a single patch cable connecting port 5 back to port 8 on Switch TVs ServerRoom (directly, or through one unmanaged device/hub sitting between them) — with no spanning-tree protection anywhere on this network to block the resulting loop. Both devices show an unrecognized/generic hardware vendor (no clean OUI match), consistent with unmanaged/no-name equipment rather than a UniFi-known client.

A forensic clue on when this started: the controller's own client records show both devices' "last seen" timestamp frozen at exactly 2026-05-17 22:59:32 UTC — within five minutes of the very first network-wide outage event recorded anywhere in this survey (§07, 2026-05-17 22:54:34). That's consistent with this loop condition beginning around that first outage and the controller losing normal visibility into these two devices from that point on, even though they're clearly still very much alive and transmitting.

No loop protection is active to contain it. Every VLAN bridge on the gateway itself reports STP disabled (stp_state=0 on br0, br10, br11, br20, br30, and br40), and this survey didn't find switch-side STP status confirmed either (swctrl stp show returned empty on every switch tested — an open item, not a confirmed "on"). The "RSTP" setting noted in the network's global config most likely governs the UniFi switch fleet's own mesh in principle, but with the loop sitting on Switch TVs ServerRoom itself, the practical fact is that nothing is currently blocking it.

This is a strong candidate explanation for the "flip-flopping between clean and severely jittery" pattern documented across a dozen-plus switches in §09 — a storm that ebbs and shifts in intensity would plausibly hit whichever switch happens to be under load at the moment it's tested, then clear moments later. It doesn't rule out Pro V8's own hardware issue (§05) — that's independently confirmed by empty-port PoE failures a storm can't explain — but it may well be inflating the apparent scope of jitter elsewhere.

Immediate resolution

  1. 1

    Go to Switch TVs ServerRoom, ports 5 and 8

    Both storm devices are attached here (192.168.0.6 on port 5, 192.168.1.7 on port 8). Look for a single cable run connecting these two ports back to each other, directly or through an unmanaged switch/hub sitting between them — that's the loop.

  2. 2

    Disconnect one leg and confirm the storm stops

    Pull the suspected loop cable at port 5 or port 8 (not any device's actual legitimate network connection) and re-run a quick capture to confirm traffic returns to normal before considering this resolved.

  3. 3

    Enable loop/broadcast-storm protection at the gateway going forward

    STP is currently off on every local bridge. Turning on storm control or STP on the gateway's own ports would prevent a recurrence of this specific failure mode.

IGMP / multicast — mostly good news, one anomaly

IGMP snooping is enabled and correctly scoped to exactly Management LAN and TV VLAN, matching the network's design intent. A live 90-second capture on the TV VLAN bridge confirms it's actually working: 10 IGMP general queries, 24 join/reports, and 9 leaves were observed — real channel-change activity, not a dead protocol. The multicast group 233.89.188.1 (a GLOP-addressed range, consistent with IPTV content) was seen alongside standard housekeeping groups (224.0.0.1, 224.0.0.2, mDNS's 224.0.0.251).

Two things worth a closer look, neither urgent: the general queries were sourced from 10.0.0.1 — an address that doesn't belong to any configured subnet on this network, worth tracing since something on the TV VLAN is answering queries under an unexpected identity. And the network's IGMP configuration designates 31 switches as eligible queriers, three of which are switches already flagged elsewhere in this report as broken: Switch V3 and Switch BeachResta Cameras (both down, §09) and Switch Pro V8 itself (§05) — worth confirming querier failover is actually working now that those are compromised, rather than assuming it is.

Fleet-wide corroboration: direct SSH access to all 154 devices

The site-wide device SSH credential was recovered from the controller's console, giving direct terminal access to every switch and access point for the first time in this survey — not just the gateway. A full health pull (uptime, load average, memory, kernel log, port/PoE status) was run against all 60 switches and all 94 APs. Two results reshape the picture above.

Elevated CPU load is fleet-wide, not unique to Pro V8. Ranked by load average, a dozen-plus switches — office Store, Kitchen, V8 - Bottom Bedroom, V7, GM office, V1, Battery house, Tailor, Kiteschool, Middlestaff - Rooms — sit in the same 1.5–2.7 range as Pro V8 (2.68, the highest), and several APs (Beach_umbrella V2 at 3.08, V7 - Bottom Bedroom at 2.60) show the same thing. Many different physical devices running hot at the same time points at a shared cause hitting the whole fabric — almost certainly the broadcast storm above — rather than each device independently failing. This revises §05: Pro V8 is the worst-hit point of a shared problem, not a uniquely broken switch.

No catastrophic failures anywhere. Every device's kernel log was checked for kernel panics, out-of-memory kills, watchdog resets, and crashes — zero matches across all 154 devices. Whatever's degrading performance here, it isn't hardware dying outright.

A real but harmless SSH quirk on `USW-Flex-Mini` switches. 8 switches on that model (shown as USMINI) rejected SSH mid-handshake (kex_exchange_identification: Connection closed by remote host) while pinging perfectly clean — a model-class limitation on this lightweight hardware, not a health problem. One switch, switch V16, refused SSH on a different model with no other explanation yet — a small open lead.

A live process snapshot points at the switching hardware itself, not a third-party process. Filtering out this survey's own SSH overhead, the CPU on loaded switches is being spent by the switch OS's own core processes — switchdrvr (the switching-ASIC driver, seen as high as 57%) and the port-statistics-collection kernel thread, recurring across several different switches, plus an IGMP-processing thread on Pro V8 specifically. That's a direct mechanistic link: a switch forced to forward, count, and drop far more traffic than normal (exactly what a broadcast storm does) will show precisely this signature on its own driver and counter threads — on many switches at once, not because each is independently failing.

Full per-device output (uptime, memory, firmware version, kernel log, port/PoE status, and a live process snapshot) is saved as individual markdown files for further analysis — see the methodology section (§14) for the file locations.


05Switch Pro V8 — the aggregation point for most guest villas

Still the highest guest-impact issue in this survey — but direct SSH access into the switch itself (below) revised part of this story: it's the worst-hit point of the fleet-wide load pattern above, plus one genuine device-local question of its own, rather than a switch with a uniquely failing power supply.

Why this outranks everything else below

Middlestaff WallBOX (§06) and the core uplink (§07) are both real and both still worth fixing — but WallBOX's blast radius is two staff-area switches, and the uplink's incidents are brief and infrequent. Switch Pro V8 sits upstream of roughly 30 downstream switches and every AP behind them — essentially all of villas V1 through V10, the beach restaurant, the beach cameras, and the kite school/bar. Every guest in that footprint inherits whatever Pro V8 is doing. Guest impact comes first, so this is now priority #1.

What's downstream of it

Via Pro V8Then reaches
Switch V7V6 & V7 villas, Switch V7 (new artur), Switch V6 - Bottom Bedroom
Switch V8 - Bottom BedroomSwitch V9 new → Switch V10 → Switch V10 Livingroom (the other persistently-jittery switch from §09) — V8, V9, V10 villas
Switch V3Switch V1, V2, V4, V5, Switch Kiteschool → Switch Kitebar, Switch BeachRestaurant, and the two down switches Switch Beach Resta & Switch BeachResta Cameras (§09)

Both of the other switches flagged as unreachable or persistently jittery elsewhere in this report (V10 Livingroom, Beach Resta, BeachResta Cameras) live downstream of Pro V8 — worth keeping in mind when this fix lands; some of that may clear on its own.

Is it correctly wired? — yes, the cabling checks out

Pulled Pro V8's own port table directly — every port, not just the flagged one:

PortConnects toSpeedPoE
1unnamed switch (192.168.0.151) — switch-to-switch1000 Mb ✓off — expected
2Switch V8 - Bottom Bedroom — switch-to-switch1000 Mb ✓off — expected
3V8 - livingroom (AP, legacy BZ2LR model)100 Mboff — worth an on-site check
4Switch V7 — switch-to-switch1000 Mb ✓good
5nothing connectedoff — moot
6nothing connectedoff — moot
7nothing connectedoff — moot
8Switch Cinnamon Service Room — its own uplink1000 Mb ✓off — expected

The cabling is fine, and — correcting an earlier read of this same table — most of the "PoE failed" ports were never supposed to carry power in the first place. Ports 1, 2, and 8 connect to other switches (switch-to-switch links don't draw PoE; those units have their own wall power), and 5–7 have nothing plugged in. Only port 3, the one actual client device on this switch, is a genuine open question — its AP isn't drawing power, worth a physical check on-site. There's no evidence of a switch-wide power-supply failure once the uplink ports are correctly excluded; total PoE budget usage was 5.92W out of a 120W budget, nowhere near exhausted.

What direct access into the switch actually showed: 94 days of uptime, and a live snapshot at 51% user + 48% system CPU, 0% idle — genuinely maxed out, not inferred. Its kernel log also shows a real history of intermittent physical link flaps on ports 1 and 8 scattered across that uptime (each triggering a brief STP forwarding/blocking cycle on multiple ports at once) — a real, if secondary, physical-layer symptom. Fleet-wide testing (§04) found a dozen-plus other switches sitting in the same elevated-load range at the same time, which points to the broadcast storm as the shared driver of most of this rather than Pro V8's hardware uniquely failing — though the 94-day uptime and the port-3 PoE question are worth addressing on their own regardless.

Immediate resolution — in order

  1. 1

    Fix the broadcast storm first (§04) — likely to resolve most of this on its own

    Since a dozen-plus other switches show the same elevated load simultaneously, the storm fix should be done before judging whether Pro V8 has a problem beyond that shared cause. Re-check Pro V8's load and jitter after the storm is confirmed stopped.

  2. 2

    Physically check port 3's AP (V8 - livingroom) for power

    The one genuine device-local PoE question — confirm whether that AP is running on its own separate power or is actually unpowered.

  3. 3

    Power-cycle Switch Pro V8 in a scheduled maintenance window regardless

    Will interrupt ~30 downstream devices — most of the guest villas — for the duration

    94 days of uninterrupted uptime is long for a switch running this hot; a clean reboot is cheap and worth doing even if the storm turns out to explain most of the load. Firmware is 7.4.1.16850 — check it against the latest available for this model while it's rebooting anyway.

  4. 4

    If jitter persists after both the storm fix and a reboot

    Only then treat it as a hardware fault specific to this unit and plan a replacement — get a spare on hand before scheduling the swap, given this is the highest-impact single device in the property after the gateway itself.


06Switch Middlestaff WallBOX is failing right now

The second most concrete, individually-pinpointed physical fault in this survey — and it's still happening as this report is written. Ranked below Pro V8 because its blast radius is limited to staff-area switches, not guest villas.

Active fault

Switch Middlestaff WallBOX (192.168.1.110, model USL8LPB) went offline and back online 211 times in the last 24 hours — roughly once every 7 minutes, with gaps ranging 2 to 40 minutes, continuing right up to the most recent reading. This comes from the controller's own device connectivity log, not a spot-check — it's a full event-by-event history, and it's unambiguous.

This switch also acts as an aggregation point: Switch Middlestaff - Rooms (192.168.1.47) and New carpentry (192.168.1.61) uplink directly through it. Every time WallBOX drops, both of those go down with it — which is likely also the explanation for some of the "here-then-gone" instability noted elsewhere in this report (§09): a downstream ripple from this one device, not independent faults.

Because each drop only lasts a few seconds, a snapshot ping test can easily miss it entirely — in fact it did: WallBOX pings perfectly clean in every spot-check sweep run for this survey. Only the controller's long-run event log caught it. That's worth keeping in mind for any future troubleshooting here: a clean ping test is not proof a device is healthy.

The switch itself is mains-powered (not PoE-input), so the leading candidates are a failing internal power supply, or an unstable electrical circuit/outlet feeding it. It is not explained by the core uplink flapping in §07 — that only accounts for 4 incidents in 19 days, nowhere near 211 in one day — this is a separate, distinct fault local to this one device.

What the on-site team should do

Physically visit Switch Middlestaff WallBOX. Check: (1) the power brick/PSU and outlet — swap the power adapter first as the cheapest test; (2) if flapping continues on a known-good outlet and power adapter, replace the switch unit itself; (3) while there, also check the uplink cable back to Switch POWER House (192.168.1.17) port 3 — reseat or replace it as a low-cost second step.


07The core uplink is degrading

The trunk between the gateway and the switch fabric — the single path every VLAN on the property depends on — has been intermittently failing, and failing more often each time.

The gateway's own kernel log tells a clear story on interface eth9, the SFP-based uplink into the switch fabric: it keeps renegotiating between 10 Gbps optical and 1 Gbps mode, and every time it does, all six VLAN bridges — management, guest, TV, senior staff, kite school, middle staff — briefly go into a disabled state together. This isn't a segment losing signal; it's the property's one shared trunk misbehaving.

Confirmed incidents (gateway uptime: 19 days, since 21 Jun 2026)

25 Jun 2026 · 21:21–21:22 EAT
~6 renegotiations in under a minute. Log records "remote side might have a problem" — the far-end switch's transceiver, not just this one, is implicated.
02 Jul 2026 · 20:38–20:39 EAT
~8 renegotiations.
7 days since prior incident
06 Jul 2026 · 20:30–20:31 EAT
~10 renegotiations — the worst cluster recorded so far.
4 days since prior incident
08 Jul 2026 · 17:03–17:04 EAT
~8 renegotiations. No further incidents logged since — worth confirming this holds.
2 days since prior incident

The gap between incidents was shrinking — 7 days, then 4, then 2 — which read as a component actively degrading rather than a stable nuisance.

Independently, the controller logged four full network-down events

Start (UTC)DurationGap from previous
2026-05-17 22:54:34113s
2026-05-23 21:39:55297s6 days
2026-06-06 21:48:04282s14 days
2026-06-20 21:53:59298s14 days

All four fall in the same evening window (21:39–22:56 EAT) — worth checking against anything scheduled on-site in the evenings: a generator test or transfer, server-room cooling cycling off, a backup job.

What the on-site team should do

Physically inspect and reseat or replace the SFP module and fiber patch on the gateway's eth9 uplink, and check the matching transceiver at the far-end switch — the log implicates both ends.


08WAN1 (fiber) has had two long outages this week

Separate from everything above — this is about the internet link itself going down, not the internal network.

The controller keeps a WAN-level downtime log going back a month. Almost every entry is brief (under 5 minutes) — WAN2/Starlink flaps occasionally, as expected for satellite. But WAN1, the primary fiber link, had two exceptions:

StartedLinkDuration
2026-07-06 08:53:15WAN1 (fiber)11.6 hours
2026-07-07 10:00:00WAN1 (fiber)22.1 hours

That's the primary internet link down for most of two consecutive days, last week. This is a different question from WAN quality (§12 below shows no bufferbloat when the link is up) — this is about WAN availability, and it's worth escalating directly with the ISP, Liquid Intelligent Technologies. Nothing on-site cabling work can fix an upstream fiber outage of that length.


09Switch-by-switch stability assessment

Every switch pinged directly from the gateway (20 packets each), repeated across four independent sweeps over roughly 24 hours, to separate real per-switch faults from one-off network hiccups.

5 switches are consistently unreachable. 2 switches show severe jitter on every single sweep — the closest thing to an individually-implicated link. A further 8 show it intermittently, which — combined with the WallBOX finding above — is more likely a symptom of shared upstream instability than 8 separate bad cables. The remaining 45 are clean and consistent throughout.

Down — confirmed unreachable, all 4 sweeps

SwitchIPModel
Switch MainGate security192.168.1.34USC8
Switch V3192.168.1.52USC8
Switch Shop USW Flex192.168.1.207USF5P
Switch Beach Resta192.168.1.213USF5P
Switch BeachResta Cameras192.168.1.232US8P60

Beach Resta and BeachResta Cameras being down together is worth checking for a shared cause on-site (same power circuit or same upstream port).

Severe jitter on every single sweep — the two most implicated links

SwitchIPJitter range (mdev, ms)Consistency
Switch Pro V8192.168.1.22023.1 – 32.74/4 sweeps
Switch V10 Livingroom192.168.1.15514.2 – 27.53–4/4 sweeps

Note on Pro V8: its own downstream leaf switches (V8-Bottom Bedroom, Cinnamon Service Room) ping perfectly clean, which points toward CPU/control-plane load on the Pro V8 unit itself rather than a cable fault to it — worth checking both the uplink cable and the switch's CPU/temperature.

Intermittent — jittery on some sweeps, clean on others

SwitchIPPattern
Switch V12 new192.168.1.453/4 severe
Switch V15192.168.0.2373/4 severe
switch sunset bar192.168.0.1583/4 severe
V18 dodatkowy192.168.0.2483/4 severe
Switch V13192.168.1.242/4 severe
Switch V17192.168.1.1492/4 severe
Switch Fitness USW Flex192.168.1.2352/4 severe
Switch BeachRestaurant192.168.1.1982/4 severe

Flip-flopping between clean and severe from one sweep to the next (rather than staying consistently bad) is the signature of a shared upstream cause — most likely the core uplink in §07 — rather than 8 individually failing switches. Recommend re-checking this specific list after the §07 fix lands; whatever's still jittery afterward is a real local fault.

Resolved / one-off — flagged once, clean on every retest

Switch V14 new, Switch Kitebar, Switch V6 - Bottom Bedroom, Switch Boutique — each spiked on exactly one sweep and stayed clean on the rest. Not worth acting on unless it recurs.

Everything else — clean and consistent

The remaining 45 switches held sub-2ms jitter with 0% loss across every sweep, including Switch V4, Switch Tailor, Switch V7, Switch Kitchen, Switch office Store (aside from its port-4 fault, §10), Switch KasiaStore, and 39 others.


10Switch & cabling health — specific ports

A live scan of every switch's port table, read directly from the controller's own database — no per-switch login required.

One port is an unambiguous fault: Switch office Store (192.168.1.174), port 4, is linked at just 10 Mbps — no current PoE device legitimately negotiates that low, regardless of age, so this points to a damaged cable, connector, or port. Trace and replace that specific run first.

Beyond that single case, dozens of ports across many different switches are linked at 100 Mbps rather than gigabit. Some of that is expected — several legacy AP models on this network (UAP-LR, U2Lv2, BZ2LR) are 100 Mbps-only by hardware design. The pattern is only worth acting on where a newer, gigabit-capable device is the one showing 100 Mbps — those specific pairs are the real candidates, and should be checked against the device model before anyone re-terminates a cable.

Read as a whole, this looks like distributed cabling wear rather than one bad switch — plausible for Cat5e runs in a humid, coastal, salt-air environment over years of service.

Confirmed / representative flagged ports

SwitchIPPortIssue
Switch office Store192.168.1.174410 Mbps — replace cable
Switch POWER House192.168.1.173uplink to failing WallBOX — reseat/replace, §06
Switch Pro V8192.168.1.2203100 Mbps PoE not good
Switch V14 new192.168.0.1335100 Mbps PoE not good
Switch Kitchen192.168.1.396, 7100 Mbps PoE not good
Switch V13192.168.1.245100 Mbps PoE not good
Switch V17192.168.1.1494, 5100 Mbps PoE not good

Full list of ~145 flagged port/device pairs available in the raw diagnostic data on request — triage against device model before dispatching a cable tester.

Is it the switch or the cable? — a definitive answer, per port

Rather than guess from datasheets, each flagged port's own advertised hardware capability was pulled from the controller — not just what speed it negotiated, but what it's physically capable of — and checked against the switch model. This separates "the switch can't do better" from "the switch can, but something's degrading the link."

Speed: the switches are not the bottleneck, anywhere. Every port sampled across all seven switch models in the flagged-port list — US8, US8P60, USC8, US16P150, USL8LP, USF5P, USMINI — reports the identical hardware capability mask, and it includes gigabit on every single port. There is no 100 Mbps-only switch or port in this fleet. So when a modern, gigabit-capable AP negotiates down to 100 Mbps, the switch on the other end was capable of better — that points at the cable, connector, or patch panel in between, not the hardware.

PoE is a mixed answer — some of it is the switch by design, the rest is a real fault. Two switch models in this fleet structurally can't deliver PoE to some or all ports, confirmed against Ubiquiti's own published specs:

  • USW-Flex-Mini (shows as USMINI) — zero PoE output on any port by design; it only accepts PoE to power itself. Every AP hanging off a Flex Mini that needs PoE was never going to get it there, regardless of cable condition — that's a switch-selection issue (wrong switch for a PoE device), not a cable fault.
  • USW-Lite-8-PoE (shows as USL8LP / USLP8P / USL8LPB) — only 4 of its 8 ports carry PoE by design. The controller's own per-port data confirms this split cleanly: on Switch V9 new and Senior staff specifically, some ports report no PoE wiring at all (port_poe: false) while others on the same physical switch report it fine — that's the model's fixed 4-of-8 layout, not inconsistent hardware.

Filtering those two cases out, 6 ports are on hardware that is proven PoE-capable and still failed negotiation — these are the real faults: Switch V4 port 6, Switch V2 port 7, Switch V14 new port 2, Switch Reception port 3, and Senior staff ports 3 and 4. Since the port itself is confirmed capable, the likely causes are a marginal cable (voltage drop under load), a switch-wide PoE budget being exceeded, or a failing power delivery negotiation at the AP — worth a cable swap first, since that's the cheapest test.


11Wireless access point health

All 94 access points checked for reachability and stability (two independent ping sweeps from the gateway), plus cross-referenced against the switch port faults in §10 — a bad wired uplink shows up as a wireless problem to guests, even though the AP's radio is innocent.

Down

5 of 94

Unreachable on both sweeps — see below.

Degraded uplink

24 of 94

Wired to a switch port at 100 Mbps or failed PoE — a cabling problem wearing a Wi-Fi complaint.

Everything else

65 of 94

Reachable, stable, wired at full speed across both sweeps.

Down — unreachable on both sweeps

Access pointIPModelNote
V13 Technical Room192.168.1.169U7LTDown + radio config shows an undefined channel
Boutique Inside192.168.1.107BZ2LRDuplicate IP — two device records share 192.168.1.107
Tennis court192.168.1.107BZ2LR
Guest - Boutique Mesh Pro192.168.1.88U7MPDown
senior staff new (R4)192.168.1.234U7EDUDown
Cinnamon Room 3 - Terrasse192.168.1.70UAL6Down

V13 Technical Room is the highest-confidence real fault here — it's unreachable and its own radio config independently shows an undefined channel on both bands, two unrelated signals agreeing. The Boutique Inside / Tennis court IP collision is worth a quick check either way: either one AP is a stale leftover record that should be removed from the controller, or there's a genuine address conflict on 192.168.1.107.

Degraded wired uplink — the AP's radio isn't the problem, its cable is

24 access points are gigabit-capable models currently wired at 100 Mbps or with failed PoE negotiation on their switch port (cross-referenced against §10, filtered to each AP's current connection — historical/stale port records were excluded). A guest standing under one of these will correctly report "bad Wi-Fi," but the fix is a cable or port, not the radio. A further 15 APs show the same 100 Mbps pattern on legacy 100 Mbps-only hardware (BZ2LR, BZ2, U2Lv2) — that's expected for those models and not a fault. §10 confirms this isn't a switch limitation either: every switch model in this fleet supports gigabit on every port, so all 24 speed shortfalls are cabling, not hardware. Of the 6 PoE failures in this list, all are on ports independently confirmed PoE-capable — genuine faults, not a switch-design limit.

Access pointIPVia switchIssue
V4 - Living Room192.168.1.69Switch V2, port 2100 Mbps
V5 - Living Room192.168.1.89Switch V5, port 3100 Mbps
V7 - Bottom Bedroom192.168.1.83Switch V7, port 8100 Mbps
V10 - Living Room *192.168.1.79Switch V10 Livingroom, port 2100 Mbps
V14 Technical192.168.1.175Switch V14 new, port 2100 Mbps PoE not good
Restaurant - Terasse192.168.1.143Switch Kitchen, port 7100 Mbps PoE not good
Senior - Downstairs192.168.0.164Senior staff, port 5100 Mbps
U7 Pro Max192.168.0.153Senior staff, port 4100 Mbps PoE not good

Remaining 16 of the 24 (Beach V4 - Mesh Pro, V7_AP Livingroom U6-Lite, New Kiteschoold inside U6 Lite, Beach_umbrella V2, Staff - Kasia Store 2, Staff - Omar Office, restaurant bar, V10 - Upper Bedroom, V9 AP Bedroom Upstairs, V9 - Living Room, Staff - Maintenance (new), the unnamed AP at 192.168.0.206, V11 - room 5, Nowy AP senior U7 Lite) follow the same pattern — full list in the raw data.

Reachability & jitter — lighter signal than the switch sweep

Only two ping passes were run against the APs (versus four for switches), so treat this as a first read rather than a confirmed pattern. Middlestaff - Outdoor (new) (192.168.1.58) showed mild, consistent jitter on both passes (~2.4ms mdev) — worth a second look but not severe. Battery house (192.168.1.227) spiked hard on one pass (35ms max) and was clean on the other — more likely a shared-cause echo from elsewhere on the network (§07) than a fault local to that AP. Every other reachable AP held sub-millisecond, consistent latency on both passes.

Housekeeping

Two access points show up in the controller with no name at all (192.168.0.192, 192.168.0.206) — worth identifying and naming them so future audits (and this one) can tell what they actually are on sight. 192.168.0.206 is also one of the 24 degraded-uplink APs above.


12Hypotheses tested

Five candidate explanations for reported network trouble, checked directly against gateway internals and controller data.

HypothesisVerdictEvidence
WAN quality (bufferbloat) Ruled out Idle RTT 10.47ms → 10.59ms under a 45s saturating load. No rise. Speedtest: 30.3 Mbps down / 40.5 Mbps up over WAN1.
WAN availability Confirmed — see §08 Two outages this week: 11.6 hrs and 22.1 hrs on WAN1 (fiber). An ISP issue, not a quality issue.
Wi-Fi / RF interference Needs a manual check Only a wired baseline exists so far (11–16ms, 1% loss). RF environment is genuinely noisy — 21,642 neighbor/rogue sightings logged. One sighting, Zanzibar White Sand Luxury 03, is worth confirming as one of your own APs rather than a cloned SSID.
Dirty / failing switch ports Confirmed, distributed One 10 Mbps fault; a broader scattered pattern of sub-gigabit links. See §10.
Conntrack exhaustion / slow DNS Ruled out Connection table at 6,686 / 524,288 — 1.3% used. DNS resolution normal aside from one isolated outlier.
L2 storm / single point of failure Confirmed — see §07 Core uplink flapping disables every VLAN simultaneously.
A specific device chronically failing Confirmed — see §06 Switch Middlestaff WallBOX: 211 offline/online cycles in 24 hours.
A degrading aggregation switch (highest guest impact) Partly confirmed — see §04 & §05 Switch Pro V8: persistent jitter, live-confirmed 0% idle CPU, 94-day uptime. Wiring confirmed clean. Direct fleet-wide access showed a dozen-plus other switches equally CPU-loaded at the same time — most of this is likely the shared storm, not a Pro V8-specific PSU failure; one AP (port 3) not drawing power is the one remaining device-local question.
L2 broadcast storm / loop (network-wide) Confirmed — see §04 1.36M broadcast/multicast packets in 60s on the Management LAN, ~99% from two devices reached via the gateway's own switch port. No STP running on the gateway's bridges to contain it.
IGMP / multicast misconfiguration (IPTV) Ruled out — see §04 Snooping enabled and correctly scoped; a live capture shows real queries, joins, and leaves in progress. One minor anomaly (querier sourced from an unrecognized IP) flagged for follow-up, not a functional failure.

13Work order — recommended actions, in priority order

  1. 1

    Find and break the Layer 2 loop causing the broadcast storm

    Switch TVs ServerRoom (192.168.1.233), ports 5 & 8 · §04

    1.36M broadcast/multicast packets in 60 seconds, network-wide impact right now. Both storm devices (192.168.0.6, 192.168.1.7) attach to this one switch — ports 5 and 8 — the textbook signature of a single loop cable connecting them. Disconnect it and confirm the storm stops. Enable loop protection on the gateway's local bridges afterward — none is currently active.

  2. 2

    Fix Switch Pro V8 — highest single-switch priority, most guests affected

    192.168.1.220 · model USLP8P · §05

    Live SSH access (§05) shows this is most likely the worst-hit point of the fleet-wide storm-driven load, not an independently failing switch — its near-zero-idle CPU is spent in switchdrvr and a port-stats thread, consistent with excess storm traffic. Order of operations: (1) fix the broadcast storm first (action 1 above) and recheck; (2) physically check port 3's AP — the one genuine PoE question mark, everything else reading "off" is expected (uplink ports that never draw power); (3) power-cycle Pro V8 anyway in a scheduled maintenance window given its 94-day uptime — it will interrupt ~30 downstream devices across most guest villas, so pick an off-peak time; (4) only plan a hardware replacement if jitter persists after both 1 and 3. Check Switch V10 Livingroom (192.168.1.155), downstream of Pro V8, after the storm fix lands — it may clear on its own.

  3. 3

    Fix Switch Middlestaff WallBOX

    192.168.1.110 · model USL8LPB · §06

    Failing every ~7 minutes, right now. Swap the power adapter first; if it still flaps on a known-good outlet, replace the switch. Also reseat/replace the uplink cable at Switch POWER House (192.168.1.17) port 3.

  4. 4

    Inspect and replace the core uplink's SFP module and fiber patch

    Gateway eth9 (192.168.1.1) ↔ far-end switch SFP

    Check both ends. Incident frequency was accelerating (7d → 4d → 2d) as of the last recorded flap.

  5. 5

    Escalate the two WAN1 outages with Liquid Intelligent Technologies

    ISP conversation, not an on-site job

    11.6-hour and 22.1-hour outages this past week on the primary fiber link — ask for root cause and an SLA commitment.

  6. 6

    Trace and replace the cable behind Switch office Store, port 4

    192.168.1.174, port 4

    Confirmed 10 Mbps link — a clear physical fault independent of what's plugged in.

  7. 7

    Physically check the 5 down access points

    192.168.1.169, 192.168.1.107 (×2 records), 192.168.1.88, 192.168.1.234, 192.168.1.70 — §11

    Start with V13 Technical Room (192.168.1.169) — double-confirmed by both a failed ping and a broken radio config. Also resolve the duplicate-IP record on 192.168.1.107 (Boutique Inside / Tennis court) in the controller.

  8. 8

    Re-terminate cabling for the 24 confirmed degraded access-point uplinks

    Full list in §11 — e.g. V4 - Living Room, V5 - Living Room, V7 - Bottom Bedroom, V10 - Living Room, V14 Technical

    Gigabit-capable APs currently wired at 100 Mbps or with failed PoE. Confirmed via §10: no switch in this fleet caps speed at 100 Mbps in hardware, so every speed shortfall here is a cable/connector to replace, not a switch to upgrade. These will read as "bad Wi-Fi" to guests standing under them, but the fix is physical, not the radio. A further 15 APs show 100 Mbps on legacy hardware where that's expected — leave those alone.

  9. 9

    Run a wired-vs-wireless comparison in a currently-complaining villa

    Have a staffer run a phone speedtest on-site to complete the Wi-Fi/RF hypothesis check.

  10. 10

    Confirm the identity of the "Zanzibar White Sand Luxury 03" SSID

    Verify it's a known AP and not an unauthorized clone of the guest network name.

  11. 11

    Name the two unidentified access points

    192.168.0.192 · 192.168.0.206

    Housekeeping — both show up nameless in the controller, making future audits harder than they need to be.

  12. 12

    Trace the unrecognized IGMP querier and verify multicast querier failover

    §04

    General queries on the TV VLAN are sourced from 10.0.0.1 — not part of any configured subnet. Also confirm multicast still works correctly now that three designated querier-eligible switches (V3, BeachResta Cameras, Pro V8) are compromised.


14Methodology

Data sources
Gateway kernel log (dmesg -T); the controller's own local database (MongoDB on 127.0.0.1:27117, databases ace and ace_stat) — the same data the UniFi web console reads; and direct ICMP sweeps of all 60 switches and all 94 access points, run from the gateway itself. All read-only, over the gateway's existing SSH access.
Switch stability testing
Four independent full sweeps of all 60 switches (20 pings each) spread across roughly 24 hours, to distinguish one-off hiccups from real recurring faults. The Middlestaff WallBOX fault (§06) was invisible to every single ping sweep — it was only caught via the controller's long-run device connectivity log, which is why that log was mined specifically after the ping data came back ambiguous.
Access point testing
Two independent full sweeps of all 94 APs (15 pings each), plus the same device connectivity log used for WallBOX (no AP showed comparable chronic flapping in the last 24 hours), plus a full port-table cross-reference against §10 filtered to each AP's current uplink (stale historical port records, like an AP that has since been relocated, were explicitly excluded — see §11).
Switch-vs-cable determination (§10)
For each flagged port, pulled the switch's advertised hardware capability for that port (not just the negotiated state) directly from the controller and checked it against the switch model — rather than relying on published datasheets alone, since the running config is ground truth for what that specific port can actually do.
Packet-level capture (§04)
Live tcpdump/tshark captures run directly on the gateway's own bridge interfaces (br0 for Management LAN, br11 for TV VLAN) — the first genuinely L2-adjacent captures in this survey, unlike earlier attempts from a routed vantage point. The Management LAN capture (60s, broadcast/multicast/STP filter only) produced 1.86GB and 1.36M packets, confirming the storm; the TV VLAN capture (90s, IGMP/multicast filter) confirmed live query/join/leave activity. Cross-referenced against the controller's IGMP snooping configuration and client records to identify the storm source devices.
Direct switch/AP SSH access (§04, §05)
The site-wide device SSH credential was recovered from the controller console (Settings → Control Plane → Device SSH Authentication) and used to connect directly to all 60 switches and 94 APs — one SSH session per device, running a single combined command to minimize load on this embedded hardware (uptime, memory, kernel log, port/PoE status for switches; uptime, memory, kernel log, radio status, client list for APs), followed by a second lightweight pass for firmware version and a live process snapshot. Full raw output for every reachable device is saved as an individual markdown file under device-health-reports/switches/ and device-health-reports/aps/ in the project folder. 15 switches and 6 APs were unreachable — cross-checked against the ping-based results elsewhere in this report; all 6 unreachable APs and 5 of the 15 unreachable switches match already-known-down devices, while 8 more switches (all USW-Flex-Mini) failed SSH specifically while pinging clean, identified as a model-class limitation rather than a health problem.
Not yet done
A hardware cable test (TDR) on flagged ports would give exact fault distance down the copper, but briefly interrupts the tested port — hold for a maintenance window. Manual Wi-Fi speedtest in a complaining location. Physical confirmation of the L2 loop (§04) — this survey identified and located the storm by MAC/IP but did not physically trace or disconnect any cable. A repeat top-process snapshot on the switch fleet once the storm is resolved would confirm whether switchdrvr/port-stats CPU usage drops back to baseline, which would close the loop on that hypothesis.
Changes made
No configuration was changed anywhere in the network. Two temporary diagnostic files were created on the gateway's own /tmp (a RAM-backed filesystem) during packet capture and deleted immediately afterward; two of this survey's own diagnostic processes that failed to exit cleanly were terminated to release that memory. Nothing was left running or stored on the gateway or on any switch/AP after this survey concluded.