By default, bosh-lite is configured to use ASG if I'm not wrong as I couldn't get "cf allow-access ..." as a registered command.

You will need to configure the network to allow proper egress to your host machine or virtualbox IP range through https://docs.cloudfoundry.org/adminguide/app-sec-groups.html