Use case assumption:
Summary of cost scenario:
We have 30 models running production. 24 of those can be run on c5.xlarge instance configured with an Amazon Elastic Inference eia2.medium accelerator machines We also have 6 deep learning models that need to run on ml.p2.xlarge instances.
Monthly cost of hosting 24 models running on ml.eia2.large:
6 Deep learning models running on ml.p2.xlarge
Total Cost Per Month = $5178+$4116+$5442+$1600+$258 = $16,594 / month