Experienced Senior Data Engineer – Cloud-Based Data Pipeline Development and Management
About Delta Airlines
Delta Airlines is a world-renowned airline that has been a leader in the aviation industry for over 90 years. With a commitment to excellence, innovation, and customer satisfaction, Delta has established itself as a trusted brand that connects people and cultures around the world. As a global airline, Delta operates a vast network of flights, providing unparalleled access to destinations across the globe. With a strong focus on employee development, diversity, and inclusion, Delta Airlines offers a dynamic and supportive work environment that fosters growth, creativity, and collaboration.Job Summary
We are seeking an experienced Senior Data Engineer to join our team and contribute to the development and management of our cloud-based data pipelines on AWS. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines that support our business operations. If you have a passion for data engineering, a strong understanding of AWS services, and excellent problem-solving skills, we encourage you to apply for this exciting opportunity.Key Responsibilities
As a Senior Data Engineer, you will be responsible for the following key tasks:- Design, build, and maintain cloud-based data pipelines on AWS, utilizing services such as Amazon EventBridge, AWS Lambda, and AWS Step Functions.
- Collaborate with cross-functional teams to understand and define data requirements, ensuring that data pipelines meet business needs and technical requirements.
- Perform data quality checks and monitoring to ensure data accuracy, completeness, and integrity.
- Optimize data pipelines for performance, scalability, and cost-effectiveness.
- Stay up-to-date with the latest AWS advancements and technologies, applying this knowledge to improve data pipeline design and implementation.
- Develop and implement personalization calculations using Python and Pydantic models.
- Design and maintain DynamoDB tables and NoSQL databases.
- Utilize Amazon Kinesis to collect, process, and analyze streaming data.
Advantages and Benefits
At Delta Airlines, we offer a comprehensive benefits package that supports the well-being and success of our employees. Our culture is built on a foundation of shared values, including Care, Honesty, Strength, Employee Administration, and Collaboration. We believe that our employees are our greatest asset, and we strive to create a work environment that fosters growth, creativity, and collaboration. Some of the benefits and advantages of working at Delta Airlines include:- Competitive salary, industry-leading profit-sharing program, and performance incentives.
- 401(k) plan with generous company matching up to 9%.
- Comprehensive health benefits, including medical, dental, vision, short-term and long-term disability, and life insurance.
- Family care support through fertility assistance, surrogacy and adoption support, lactation support, and programs that help with family care in all stages.
- Comprehensive wellness programs to support physical, mental, social, and financial well-being, including access to a employee assistance program, free financial education, and resources supporting mental health.
- Domestic and international flight privileges for employees and qualified family members.
- Professional development opportunities to achieve long-term career goals.
- Participation in local and global community service initiatives focused on sustainability and reducing our carbon footprint.
- Business resource groups to connect employees with shared interests, provide perspective, and help implement procedures.
- Award recognition and grants through the Relentless Together platform.
- Access to over 500 discounts, specialty savings, and deliberate benefits through Deltaperks, including vehicle and lodging rentals, auto, home, and pet insurance, legal services, and childcare.
Requirements and Qualifications
To be successful in this role, you will need to possess the following qualifications and skills:Minimum Qualifications
- A bachelor's degree in computer science, data science, or a related field.
- Strong understanding of AWS services, including Amazon EventBridge, AWS Lambda, and AWS Step Functions.
- Excellent problem-solving skills and ability to work independently and as part of a team.
- Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Preferred Qualifications
- Four-year degree in software engineering, data science, or a related field.
- 3+ years of experience in data engineering, with a strong understanding of data modeling, data quality, and data security.
- Experience with Python and serverless technologies, including AWS Lambda and AWS Step Functions.
- Strong critical thinking and analytical skills, with the ability to design and implement complex data pipelines.
- Experience with personalization, Python, Pydantic models, DynamoDB, and NoSQL databases.
- Experience with Amazon Kinesis and streaming data processing.