Cross Cloud Resource Manager
A multi-cloud consolidated resource platform and forecasting application. Powered by natural language querying.
Problem
Company’s cloud usage increased exponentially
5 business lines, Many teams, 3 cloud providers
Data consolidation for reporting and budgeting was a major challenge across clouds.
Stakeholders' Requirements
Consulting & Tax Business Lines
-
A single place to view all cloud resources
-
Filter by billing account, resource ownership
Leadership (CIO Office)
-
A single place to view cloud usage
-
Filter by business lines, cloud providers
-
Forecasting cloud costs for budgeting *
Other Stakeholders
- Data Engineering Team
- Cloud Operations Team
Our Approach
Data consolidation
-
Ingest AWS, Azure and GCP data into BigQuery
Building a queryable UI
-
Backend API layer to serve consolidated data
-
React frontend for interactive filtering and self serve access
-
Caching hot queries and responses for charts, pagination
Forecasting Model
-
Vertex AI to run ARIMA and Exponential Smoothing models
-
Store forecasts in BigQuery
-
Serve forecasted data in React UI + enable natural language querying
Impact
- Delivered a unified cloud resource database and forecasting tool
-
Cloud resource database further used for SOC2 audits
-
Reduced reporting time by 90% per month, enabling faster budgeting decisions
-
Improved visibility for leadership and reduced manual processes.
-
Reusable data pipelines
-
Recognized with a Spot Award for cross-functional delivery and Gen AI integration