Azure "App Service" - Django and SQLite
Given that your local and Azure test runs show a similar multiple from best to worst case and that you only have a 30MB database file, my guess is that your Azure host is simply a much slower CPU.
This is backed up by the fact that they do throttling for some spec VMs. It is also something that has been noted in comparison to AWS. I imagine the same is true for your App Service platform.