Unable to pull jar file from JFrog Artifactory repo when running Spark job on K8's
You didn't mention how you are making sure how you are pulling the jar when you tested your job locally, or perhaps you haven't tested it yet. As per Advanced Dependency Management:
Spark uses the following URL scheme to allow different strategies for disseminating jars: hdfs:, http:, https:, ftp: - these pull down files and JARs from the URI as expected
And:
Users may also include any other dependencies by supplying a comma-delimited list of Maven coordinates with --packages. All transitive dependencies will be handled when using this command. Additional repositories (or resolvers in SBT) can be added in a comma-delimited fashion with the flag --repositories. (Note that credentials for password-protected repositories can be supplied in some cases in the repository URI, such as in https://user:password@host/.... Be careful when supplying credentials this way.)
If you are Jfrog repo or Jar file requires credentials looks like you will have to pass the credentials in the URL: https://user:password@host/...