TrustRadius: an HG Insights company

AWS Batch

Score7.8 out of 10

43 Reviews and Ratings

What is AWS Batch?

With AWS Batch, users package the code for batch jobs, specify dependencies, and submit batch jobs using the AWS Management Console, CLIs, or SDKs. AWS Batch allows users to specify execution parameters and job dependencies, and facilitates integration with a broad range of popular batch computing workflow engines and languages (e.g., Pegasus WMS, Luigi, Nextflow, Metaflow, Apache Airflow, and AWS Step Functions).

Top Performing Features

  • Logging

    Logging and audit trails to ensure regulatory compliance

    Category average: 8.5

  • Application integration

    Integration with a broad range of enterprise applications

    Category average: 8.4

  • Central monitoring

    A central monitoring dashboard provides data on trends and forecasts

    Category average: 8.9

Areas for Improvement

  • Multi-platform scheduling

    Multi-platform scheduling is the ability to centrally manage a business process from end-to-end

    Category average: 9.1

  • Analysis and visualization

    Analysis and visualization tools provide clear understanding of critical errors and helps prioritize errors

    Category average: 8.2

  • Alerts and notifications

    Alerts and notifications enabling management by exception

    Category average: 8.7

Why AWS Batch is Blessing for some and curse for others

Use Cases and Deployment Scope

We encountered issues orchestrating long-running tasks in Lambda functions, as they have a limit of 15 minutes. We needed a solution that could be triggered from AWS Step Functions. Then we found yes it's a bit tedious to set up, has a steep learning curve but once that's passed you can easily run a 24 or 48 hours or other long-timed task without any issues, which helped our use case where needed to run a task which took 24 hours even with AWS Batch's Compute

Pros

  • Easy to orchestrate and trigger jobs
  • No time limit issues like lambda
  • Multiple Jobs can be run in same single compute and job queue
  • JOb queue can queue up task for parralled or serialization

Cons

  • Steep Learning Curve
  • Setting up jobs could be easy
  • Giving roles access to compute environment is hard and confusing

Return on Investment

  • Well compared to the cost of having multiple lambda's or some other custom solution working, it has has a postiive impact
  • Helped in orchestrating the jobs, has saved time of developers

Usability

Other Software Used

Amazon CloudWatch

AWS Batch

Use Cases and Deployment Scope

We need to not manage the machines, very easy to use, great dashboard, fully supported SDK for programmatic access. We were short of resources, so we used batch which helped with no need of monitoring underlying infrastructure.

Pros

  • No need to manage underlying infrastructure.
  • Easy Dashboard for monitoring jobs.
  • Great SDK, programmatic access.

Cons

  • Dashboard does not have search, filters.
  • We cannot configure machine allocation.
  • Jobs history is very limited.

Return on Investment

  • Very positive impact as we need not manage underlying infrastructure.
  • Monitoring gave insights which helped in ROI.
  • It helps running jobs at scale.

Alternatives Considered

AWS Auto Scaling, AWS Certificate Manager, AWS CloudFormation and AWS CloudTrail

Other Software Used

AWS Auto Scaling, AWS CloudFormation, AWS CloudTrail

AWS S3 has great value!

Pros

  • S3 amount of files
  • Easy to share files to other sites
  • Like that the files and folders can be open and public or completely private
  • I like that you can have double or mirroring in different Data Centers for Data Recovery

Cons

  • It would be nice if the website has embedded little videos for how to do things, since I had to first go to YouTube to see how to figure things out.
  • The words are very techy- which I don't mind too much considering the diversity of the apps and the value, but that does not work for a lot of regular solopreneurs who don't come from the tech world.

Return on Investment

  • The value is there for me as it supports many files. Lots of content.

Alternatives Considered

ClickFunnels

Automating jobs with AWS Batch

Pros

  • Automate jobs
  • Manage performance
  • Pay per use

Cons

  • Provide more documentation
  • Provide in-house training for better use of product

Return on Investment

  • Saves cost overall
  • Performance monitoring
  • Automated alerts

AWS Batch is great service for Multi Jobs execution and scheduling

Use Cases and Deployment Scope

We have multiple scraping jobs written and this needs to be managed, we were facing difficulty to run, then we moved to AWS batch where we are running multiple jobs very easily and efficiently, so mainly we are using AWS for cost saving and optimisation, We are running 100s of jobs currently

Pros

  • Fully Managed service
  • We can use other AWS services, it is well integrated
  • Cheaper
  • Best resource utilisation

Cons

  • Jobs monitoring dashboards are not matured
  • Documentation and support is something which can be improved
  • Sometime i faced the slow response or slow in performance i would say

Return on Investment

  • Overall over business is able to save the cost
  • Saved our times to improve the existing process
  • Able to integrate with other applications as well, so that is plus point

Alternatives Considered

Azure Batch, AWS Config and AWS OpsWorks

Other Software Used

AWS Auto Scaling, AWS OpsWorks, AWS Config