Expert · Incident · 12 of 180:00 / 15:00

Some users get errors, others are fine

Problem

The sales team gets timeouts on the portal, and one server dropped out of rotation.

Your job
  • Get vm-acct and vm-sales both reaching lb-portal on 443
  • Get vm-web1 and vm-web2 both passing the health probe
Without breaking
  • Keep SSH from users to the servers blockedbroken
  • Keep UFW running on both serversbroken
Background

"Accounting can use the portal, but the sales team, new since Monday, gets timeouts. And ops says one server dropped out of rotation." The portal runs on vm-web1 and vm-web2 behind lb-portal, an internal load balancer at 10.1.1.10. Accounting is subnet-acct, sales is the new subnet-sales. Users never get SSH to the servers, and UFW stays on on both.

How to work it
  1. 1See it fail

    Prove the problem yourself before you change anything. Reports are often wrong.

    VM commands forVMs: Linux
    1. ssh vm-sales
      What's this?

      Opens a shell on vm-sales, so the next commands run on that VM. In this lab it's a shortcut. In real Azure you'd connect through something like Azure Bastion, or SSH to an address you can reach.

    2. nc -zv 10.1.1.10 443
      What's this?

      netcat, a standard Linux tool. Tries to open a TCP connection and reports whether it worked.

      • -z only check whether the port answers. Send no data
      • -v print the result in words
      • 10.1.1.10 where to connect
      • 443 the port to try

    Ticks off when the test runs on vm-sales.

  2. 2Find where it stops
  3. 3Name the cause
  4. 4Fix it and test again
Sources on Microsoft Learn (4)
0/2 changes
Network map
?
  • Resource group, the outer dashed frame
  • Virtual network, with its address space top right
  • Subnet, with range and usable IPs (5 reserved)
  • Network security group. A small shield on a VM's NIC means the NIC has one too
  • Route table on the subnet
  • NICVM Appliance Private endpoint
  • Peering Connected Initiated or access off
  • Goal working Goal broken, X marks where it stops
  • Private DNS zone, dotted lines go to linked VNets
  • Orange pulse: what your last command changed. Drag to pan, Ctrl and scroll to zoom.
Resource grouprg-labvnet-app: tap to inspectVirtual networkvnet-app10.1.0.0/16subnet-web: tap to inspectsubnet-web10.1.1.0/24 · 251 usablensg-webvm-web1 10.1.1.4: tap to inspectNICvm-web110.1.1.4vm-web2 10.1.1.5: tap to inspectNICvm-web210.1.1.5lb-portal-fe 10.1.1.10: tap to inspectLBlb-portal-fe10.1.1.10subnet-acct: tap to inspectsubnet-acct10.1.2.0/24 · 251 usablevm-acct 10.1.2.4: tap to inspectNICvm-acct10.1.2.4subnet-sales: tap to inspectsubnet-sales10.1.3.0/24 · 251 usablevm-sales 10.1.3.4: tap to inspectNICvm-sales10.1.3.4
  • vm-sales → lb-portal-fe:443should work: not working
  • vm-acct → lb-portal-fe:443should work: working
Goals 0/4
Cloud Shell · bashVMs: Linuxrg-lab · eastus2
cloudshell:~$