In current Android Studio version (3.6 rc1), you can import png image directly.File-> New-> Image Asset.
In the Asset Type, select Image, provide path to your image file and click on Next and Finish buttons.
Android Studio would do the conversion for you.