The default docker-compose.yml from the guide has the docker lemmy network set as internal. You need to make it not an Internal network.

Source: Did the same thing with the same problem, on Oracle ARM64 VPS.