.NET Core 2.1 Azure Web App: The specified CGI application encountered an error and the server terminated the process
So finally, I saw there were few extensions added to my azure app service and post deleting the extensions under "Custom" my service is running as expected.