Challenges
Manual setup of their AWS Infrastructure failed to gain on-demand scale to accommodate their growing customer base.
Sub-optimal CI/CD flow presented both development and performance bottlenecks.
Scattered dashboards with limited visibility provided little scope for early detection and gave way to longer mean time to resolution of glitches.
Required a high degree of precision while managing tens of terabytes of data, critical for real-time tracking.
Poor security posture and network configuration.
Infrastructure Preferences
Solutions
Seamless GKE setup and streamlined deployments across all environments on GCP via BuildPiper
Managed multi-cloud setup of their environments – Preprod, Staging, and Production across aws and GCP
Ensured consistency and efficiency by implementing CI/CD deployment for all environments in AWS by creating an AMI image of the application and using it to deploy to different environments
Implemented 360-degree monitoring with a centralized dashboard that integrated with Prometheus, Grafana, and Alert Manager
Implemented centralized logging solution with EFK stack – Elasticsearch, Fluentd, and Kibana
Created a reliable data pipeline with open-source tools like – Sentry, Jupyter Notebooks, Jupyter Lab, Apache Airflow, Arrango-db, Rabbitmq, Strap API
Enabled Multi-factor authentication with IAM in AWS, Service Account in GCP, and OpenVPN setup
Enabled data storage via Amazon S3 for snapshots of Elasticsearch cluster, MongoDB, Postgres, Airflow dags, and RDS backup.
Performed complete security audit for finding loopholes and non-compliant procedures
Implemented WAF for application security
Deleted unnecessary ami and snapshots. Rightsized volume size of the servers as per usage
