Cost reduction with Amazon EMR on EKS

Documentation is quite good and the product is regularly updated, so new features regularly come out. The setup is straightforward enough, especially once you have already established the overall platform infrastructure and the aws-cli APIs are easy enough to use. It would be nice to have some out-of-the-box integrations for checking logs and the Spark UI, rather than relying on know-how and digging through multiple levels to find the informations

Based on my experience, Amazon EMR is well suited for companies with a good level of support on the Platform and Data Platform level, since it needs to be properly set up to avoid incurring in extra costs: it's quite easy to give more and more resources, so a job will eventually run but it's important to avoid extra costs. In general EMR on EC2 has been the most expensive of the EMR subproducts, while EMR on EKS has a good balance of giving enough resources to the jobs to run while maintaining costs low. The other recommendation is to use the latest versions of the EMR images, as otherwise the support from Amazon might not be very helpful.