FinOps Hub - Operational Cost

[kstepha0]

Hi all, recently deployed the hub with a single subscription-level scope without data explorer for testing and proof of concept. Monitoring the cost on the resource group, I'm finding a daily operational cost of $2.50 on average; is this to be expected? The subscription has <$50k total cost/year. Thanks in advance for any insight!

[flanakin]

How much data did you ingest? Historically, we've seen ~$5 USD per million, but that can fluctuate either way based on the amount of data generated by the services you use.

[kstepha0]

Hi, the subscription in scope has a total cost of $30k/year. Looking at the cost breakdown, the data factory is running at an approximate cost of $3 per day for this scope.

[flanakin]

How many months have you ingested? Did you backfill a lot of data upfront? If you look at the ADF pipelines, how much time are they taking? That does seem very high. It would be good to understand where that cost is coming from.

How much is storage? When I last looked at our test account, it was $100K/mo and the cost was $2 for storage and $3 for ADF for 13mo of data. But as a test account, the usage there will likely not have as many records as you might have. That ultimately depends on how the services you use track usage.

[kstepha0]

The daily ingestion has been running for approximately a week. Immediately after deployment, I backfilled 12 months. Looking at today's pipelines, they took <2 minutes (msexports_ETL_ingestion), 3m30s (msexports_ExecuteETL), 20s (config_runExportJobs) and 4m44s (config_startExportProcess).

The storage is $0.12 USD/day. The largest daily cost is the data factory, averaging $3 USD per day.

There are 44 resources in the single subscription that is in scope. Thanks for your insight

[flanakin]

Those times look good. config_StartExportProcess may be long. I don't know what the times usually are off the top of my head.

If you're okay with not having control over the timing of when exports are run, you could stop using managed exports and rely on the Cost Management export scheduling. That would cut some of the time.