As a Senior Data Engineer at Andina Tech, you'll play a key role in managing and optimizing large-scale data infrastructures in the cloud. You'll work with cutting-edge technologies, solving complex problems in data processing, ETL pipelines, and cloud environments to deliver scalable and high-performance solutions.
Your Mission
- ✓ Work with AWS technologies to build and maintain large-scale data processing solutions, ensuring data integrity and high performance.
- ✓ Develop and optimize ETL processes in a cloud environment, ensuring efficient data ingestion, transformation, and loading.
- ✓ Contribute to the design and maintenance of Data Lakes, Data Warehouses, and Data Lakehouses, ensuring scalability and security.
- ✓ Work with multidimensional modeling to support analytics and business intelligence.
- ✓ Manage code versioning and collaborate efficiently using Git and GitHub.
- ✓ Automate CI/CD pipelines to ensure quick and secure delivery of data solutions.
What We're Looking For
- ✓ A strong passion for cloud computing, data infrastructure, and modern web development, with a focus on performance, reliability, and security.
- ✓ Proven ability to deliver high-quality, scalable solutions that meet the evolving needs of clients while ensuring reliability and performance.
- ✓ Extensive experience taking ownership of projects and valuing a culture of trust, accountability, and mutual respect.
Must-Have Skills
- ✓ Experience with AWS Glue, Amazon S3, Amazon Athena, EC2, DynamoDB, and AWS Lambda.
- ✓ Expertise in ETL processes within cloud environments.
- ✓ Proficiency in Python and PySpark for large-scale data processing.
- ✓ Strong knowledge of SQL and NoSQL databases.
- ✓ Hands-on experience in Terraform and Docker for infrastructure automation and containerization.
- ✓ Proficiency in Git and GitHub for efficient collaboration and version control.
- ✓ Experience in automating CI/CD pipelines.
- ✓ Proficiency in English (advanced level).
Nice-to-Have Skills
- ✓ Experience with AWS Step Functions, Redshift, and EMR.
- ✓ Familiarity with agile methodologies (Scrum, Jira).
- ✓ Linux/Shell scripting skills.
- ✓ Experience with pipeline orchestration tools such as Airflow.
- ✓ Familiarity with Lakehouse tools (Iceberg, Hudi, Delta).
- ✓ Knowledge of GitHub Actions for continuous integration and delivery.
- ✓ A Computer Science degree is preferred, but we value non-traditional backgrounds as well.
Your path to success starts here. Join us in creating the future of tech.
We're eager to have you on our team. Fill out the form to apply or get in touch with us.