Can’t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock’ (2)

I'm getting the following error when I run mysql -u root -p

Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)

How do I solve this problem under CentOS / RHEL / Red Hat Enterprise Linux server 5.x or 6.x?

Read answer to: "Can’t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock’ (2)"