- Lokasi: Austin
- Negeri:
- Negara: United States of America
- Rumah
- ...
- Peranan Terbuka
- Butiran Peranan
Perihalan & Keperluan
The Senior Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and architectures. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data solutions align with business needs and objectives.
Key Responsibilities:
- Analyze business/functional requirements, Design, develop, and optimize data pipelines and workflows
- Collaborate with data scientists and analysts to gather requirements and deliver data solutions
- Implement and maintain ELT processes for large-scale data sets
- Ensure data quality and integrity across various data sources
- Monitor and troubleshoot data pipeline performance and reliability
- Perform code reviews and ensure that all solutions are aligned to pre-defined architectural standards, guidelines, best practices, and meet quality standards
- Optimize database systems for performance and scalability
- Implement data security and compliance measures
- Understand and comply with the established software development life cycle methodology
- Proactively identify opportunities for process improvements and implements the same
- Establish and enhance technical guidelines and best practices for the integration development team
- Utilize subject matter expertise in area of enterprise applications, solutions to evaluate complex, sensitive business problems and architect technical solutions- Mentor junior data engineers and provide technical guidance
- Stay updated with emerging data technologies and industry best practicesQualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
- 8+ years leadership of design and development in BI environments scaling to hundreds of users and multiple terabytes of content
- Proficiency in SQL and experience with relational databases
- Knowledge of data warehousing solutions (e.g., Snowflake, Redshift)
- Experience with big data technologies (e.g., Hadoop, Spark).
- Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud)
- Strong programming skills in languages such as Python, Java, or Javascript
- Strong understanding of RDBMS concepts, data modeling techniques (3NF, Dimensional), DB programming, Performance tuning skills
- Excellent problem-solving and analytical skills
- Strong communication and collaboration abilities
- Experience working in Agile methodology
Preferred Qualifications:
- Experience with real-time data processing and streaming technologies (e.g., Kafka, Flink)
- Experience in the gaming industry or customer experience fields