Transforming Hyatt's Cloud Infrastructure and Data Management
Navjot Singh
Cloud Infrastructure Architect
Consultant
CTO
Hyatt
Hyatt Regency
Statement:
Hyatt faced challenges in managing its growing AWS infrastructure efficiently. The existing setup lacked optimal resource utilization and had issues with resource isolation, data cascade between environments, and automated deployment of data lake components. Additionally, the deployment process was prone to errors due to a lack of resource locking and isolation for different development stages.
Resolution:
Terraform Integration and AWS Cleanup: Migrated AWS resources to Terraform for better infrastructure management. Performed cleanup activities across multiple AWS accounts to optimize the infrastructure.
Continuous Integration and Deployment Pipeline: Developed a Jenkins pipeline integrated with Terraform to replace the existing Rundeck setup, facilitating automated and streamlined CI/CD processes across development, staging, and production environments.
Infrastructure as Code: Maintained terraform code in Stash for provisioning AWS infrastructure involving multiple services. Ensured secure and efficient deployment by storing terraform state in a remote S3 bucket with locking via DynamoDB.
Enhanced Security and Deployment Process: Utilized Kubernetes secrets in Docker containers for secure AWS access, and implemented LDAP group-based authentication in Jenkins. Also, created a dual-repository system in Stash for separating terraform source code and variable files, allowing for more controlled and customizable deployments.
Technical Leadership and Data Lake Support: Provided leadership in AWS infrastructure management, supporting the automated deployment and development of Data Lake components. Implemented Kinesis streams with Lambda for data transfer between different AWS environments.
Resource Isolation and User Profile Management: Set up isolated Sagemaker studio user profiles for the Data Science team, ensuring resource segregation and security.
Migration and Optimization: Migrated old production resources and development workloads to new repositories and accounts, improving the overall efficiency and organization of the development process.