It turns out, if there is an index file likes index.html, Nginx will not show the directory list even if autoindex is on.