How to Configure Nginx Load Balancing with Upstream

Nginx load balancing distributes traffic across backend servers. Selecting the right method and configuring health checks ensures reliable operation. This guide walks through the specific troubleshooting steps to diagnose and resolve load balancing issues.

Before You Begin

Before you begin, be sure to have the following in place:

• A Linux server with the relevant software installed
• Access to the command line interface
• Appropriate permissions (root or sudo)

Quick Fix

Wrong

upstream backend {\n    server 10.0.0.1:80;\n    server 10.0.0.2:80;\n}

Wrong: Default round-robin without tuning

Right

upstream backend {\n    least_conn;\n    server 10.0.0.1:80 max_fails=3 fail_timeout=30s;\n    server 10.0.0.2:80 max_fails=3 fail_timeout=30s;\n    keepalive 32;\n}

Right: least_conn with keepalive and failure detection

Output

Upstream backend load balancing:\n  Method: least_conn\n  Keepalive: 32 connections\n  Failure detection: 3 fails / 30s

Prevention

To avoid future issues, follow these best practices:

• Use least_conn for uneven request durations, ip_hash for session persistence
• Enable keepalive for upstream connections to reduce overhead
• Set max_fails and fail_timeout for automatic server removal
• Use zone directive for shared state across worker processes
• Monitor upstream health with the status module (NGINX Plus or open source)

DodaTech Tools

For further assistance with any of the above issues, consider using DodaTech consulting services or DodaTech tutorials for more in-depth guidance.

Common Mistakes with upstream load balance

1. Forgetting that lazy evaluation defers computation until the value is forced, causing space leaks with unevaluated thunks
2. Using return to exit a function early instead of wrapping a pure value in the monad
3. Mixing let bindings with <- bindings in do notation, producing type errors

These mistakes appear frequently in real-world NGINX code. DodaTech's contributors have identified these patterns through analysis of open-source projects and production systems.

Practice Exercise

Write a pure function that safely divides two integers using Maybe, then test it with edge cases like division by zero and negative numbers.

This exercise reinforces the concepts covered in this guide. Try implementing it before checking online solutions.

FAQ