Submit and monitor SLURM jobs using Apache Airflow
I can't give a demonstrateable example but my inclination would be to implement an airflow sensor on top of something like pyslurm. Funnily enough I came across your question merely when looking to see if anyone has already done this!
EDIT: There is an interesting topic on regarding the use of excecutors for submitting jobs too
Best of luck