Data Engineer

Job Description:
We are looking for an Data Engineer with a focus on PostgreSQL optimization and extensive experience in database migrations from MS SQL Server to PostgreSQL leveraging AWS Database Migration Service (DMS). In this role, you will play a key part in transitioning our data infrastructure to a more optimized and scalable system, ensuring performance and data integrity throughout the process.

Key Responsibilities:

• Lead and facilitate database migration from MS SQL Server to PostgreSQL, using AWS DMS to minimize downtime and ensure data accuracy.
• Optimize PostgreSQL databases for performance, focusing on query optimization, indexing strategies, partitioning, and schema design improvements.
• Collaborate with cross-functional teams (product, software engineers, data science) to understand data requirements and develop robust data solutions.
• Monitor and troubleshoot PostgreSQL database performance issues, ensuring high availability and reliability.
• Design, build, and maintain efficient ETL pipelines to transfer data between various systems.
• Establish and document best practices for database management, security, and disaster recovery in a cloud environment, with an emphasis on AWS.
• Develop migration plans and roadmaps, including testing, validation, and post-migration optimization.

Qualifications:

• Strong expertise with PostgreSQL, especially in performance tuning, indexing, query planning, and schema optimization.
• Proven experience with database migrations from MS SQL Server to PostgreSQL, with hands-on experience using AWS Database Migration Service (DMS) for large-scale migrations.
• Proficiency in SQL and relational database design principles.
• Experience with ETL processes, data pipelines, and integrating data from multiple sources.
• Familiarity with cloud platforms, particularly AWS (e.g., RDS, Aurora) and their database services.
• Strong understanding of database security best practices, including encryption, access management, and auditing.
• Strong problem-solving skills, with the ability to identify and resolve complex data-related issues.
• Excellent communication and collaboration skills in a cross-functional and remote team environment.