In an overlay network, the performance of individual applications on a per-user basis is monitored to assess metrics such as latency, packet loss, and jitter. This allows network administrators to evaluate how well applications are performing for each user and identify any potential issues affecting application delivery.