Run batch jobs using AWS Batch

AWS Batch enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory optimiz…

AWS Batch enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory optimized instances) based on the volume and specific resource requirements of the batch jobs submitted.



what is a batch job?

A batch job is a job with a start and end to it as opposed to a continuous job that runs 24X7



AWS batch features

  1. Batch processing service at any scale.

  2. It provision the right amount of EC2 instances or Spot instances for processing the batch job based on the volume and the requirements

  3. You submit or schedule batch jobs and AWS manages the rest

  4. There run as Docker images.



Use cases

  1. Pulling data form somewhere at night

  2. Backups at midnight

  3. Financial data processing each day


Print Share Comment Cite Upload Translate
APA
Ajit Singh | Sciencx (2024-03-29T15:54:56+00:00) » Run batch jobs using AWS Batch. Retrieved from https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/.
MLA
" » Run batch jobs using AWS Batch." Ajit Singh | Sciencx - Tuesday August 31, 2021, https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/
HARVARD
Ajit Singh | Sciencx Tuesday August 31, 2021 » Run batch jobs using AWS Batch., viewed 2024-03-29T15:54:56+00:00,<https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/>
VANCOUVER
Ajit Singh | Sciencx - » Run batch jobs using AWS Batch. [Internet]. [Accessed 2024-03-29T15:54:56+00:00]. Available from: https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/
CHICAGO
" » Run batch jobs using AWS Batch." Ajit Singh | Sciencx - Accessed 2024-03-29T15:54:56+00:00. https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/
IEEE
" » Run batch jobs using AWS Batch." Ajit Singh | Sciencx [Online]. Available: https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/. [Accessed: 2024-03-29T15:54:56+00:00]
rf:citation
» Run batch jobs using AWS Batch | Ajit Singh | Sciencx | https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/ | 2024-03-29T15:54:56+00:00
https://github.com/addpipe/simple-recorderjs-demo