The symptom
Password resets and changes did not behave consistently from the user's actual authentication path.
StarPet • Identity • Active Directory • Incident Analysis
A user-facing password problem became a multi-layer identity investigation spanning RODC behavior, writable-domain-controller discovery, stale former-DC state, replication, DNS/DC Locator, Kerberos password-change paths, Wi-Fi authentication, and Microsoft 365 validation.
Password resets and changes did not behave consistently from the user's actual authentication path.
The local RODC behaved as an RODC should—but the site still lacked a reliable, clean writable-DC path.
DC Locator, replication, DNS/SRV behavior, service reachability, and user validation all told the same story.
Do not stop at “the reset synchronized.” Prove the entire path from write to user-visible authentication.
The architecture
The site used a local read-only domain controller. That is valid architecture only when write operations can reliably reach a writable controller elsewhere and the resulting state returns to the authentication path users actually consume.
The investigation therefore treated the password reset as a transaction with multiple checkpoints rather than a single success/fail event.
Checkpoint 01
A reset is not proven until the user can authenticate through the path they actually use.
Evidence chain
The local RODC was discoverable and carried the expected read-only flags. But a site-scoped request for a writable DC failed, while an unrestricted writable lookup found a remote controller. That separated “expected RODC behavior” from “healthy writable path.”
flags: ... PARTIAL_SECRET ...
Expected behavior for the local read-only controller.
ERROR_NO_SUCH_DOMAIN (1355)
No usable writable DC was discoverable inside the site scope.
flags: WRITABLE ... FULL_SECRET
The domain had writable controllers; the dependency was remote.
57+ day delta · 10/10 fail · RPC 1722
Stale former-DC state remained visible in locator / replication evidence while the server was offline.
Why the easy answer was not enough
A cloud-side success only proved that one portion of the transaction completed. It did not identify which writable controller accepted the change, how long the update took to return through the site authentication path, or whether the local RODC could immediately validate the new credential.
Diagnostic toolkit
nltest /dsgetdc:<domain> /site:<site> /force
nltest /dsgetdc:<domain> /site:<site> /force /writable
nltest /dsgetdc:<domain> /force /writable
repadmin /showrepl
repadmin /replsummary
dcdiag
Resolve-DnsName _kpasswd._tcp.<domain> -Type SRV
Test-NetConnection <writable-dc> -Port 464
Blast radius
The affected virtualization host carried multiple site services. Once its domain trust became part of the incident, the question was no longer “can one person reset a password?” It became “what else depends on this host and its identity path?”
Parallel signal
Separate troubleshooting found missing authentication logs, an unavailable site ISE node, and failover behavior that did not process requests as expected. Port-authentication settings were also found in an open/bypass state and required correction and validation.
That was not automatically the same root cause as the password path. Treating the symptoms separately while still mapping their shared dependencies prevented one outage from hiding another.
Different transaction. Shared requirement: prove the complete path.
Incident progression
Local RODC behavior was confirmed, but site-scoped writable discovery failed and stale former-DC state remained visible.
Long replication delta, repeated failures, RPC errors, and stale locator references established that this was more than ordinary RODC behavior.
The investigation defined the exact proof required: write target, propagation, site validation, cloud state, and real user sign-in.
Later correspondence confirmed the former writable DC had been brought online after more than 70 days offline and connected to the production domain before demotion.
Cleanup/demotion and post-change checks covered the RODC, DNS, client logon, password behavior, Microsoft 365 applications, endpoint management, privileged access, and backup services.
Validation discipline
The validation plan deliberately crossed layers. A domain controller coming online was not enough. The end state had to be tested from infrastructure health through user authentication and dependent services.
Outcome
The resulting record classified the event as a high-severity, multi-day disruption affecting Active Directory/domain services, Wi-Fi authentication, and Microsoft 365. The investigation connected direct command output, replication evidence, architecture, escalation questions, remediation activity, and a cross-service validation checklist into one coherent fault-domain story.
Evidence policy: This page is reconstructed from direct testing, incident correspondence, migration/identity evidence, and later audit documentation. Internal hostnames, IP addresses, personal contact details, private screenshots, and proprietary documents are not published. The public diagrams preserve the technical reasoning without reproducing confidential source material.