Data Integration Specialist (Hybrid)

Symmetrio is actively recruiting for a Data Integration Specialist for our customer, a large government organization in Philadelphia, PA. As a Data Integration Specialist, you will play a crucial role in the seamless migration, integration, and management of large-scale data across Amazon S3 and Redshift environments. This role demands not only technical expertise but also an in-depth understanding of data architecture, data security, and integration strategies to ensure robust data infrastructure.

This is a full-time, hybrid position requiring on-site presence in Philadelphia 2 days per week.

Responsibilities

Design, develop, and deploy ETL/ELT data pipelines to facilitate the transfer of complex datasets into Amazon S3, using tools such as Azure Data Factory, optimized for performance, resilience, and scalability

Implement automated workflows to streamline the continuous data migration process, ensuring that data ingestion and processing run smoothly with minimal manual intervention

Set up and manage Amazon S3 buckets for optimized data storage solutions, and configure data schemas and tables within Amazon Redshift to accommodate evolving business needs

Migrate cleaned and preprocessed data efficiently into Amazon S3 and Redshift, ensuring data consistency and integrity throughout the process

Proactively monitor data pipelines for performance, identifying potential bottlenecks or failures, and implementing solutions to maintain optimal data flow

Regularly assess and refine data integration processes to enhance system efficiency and scalability, leveraging best practices in cloud and data engineering

Maintain meticulous documentation for all data integration processes and ensure all activities comply with data governance standards, security protocols, and company policies

Requirements

Minimum of 3 years of experience working as a Data Integration Specialist

Proficiency with cloud platforms, particularly AWS (S3, Redshift, Lambda) and Azure Data Factory

Strong skills in SQL and experience with ETL tools

Demonstrated expertise in data security and integrity measures, including encryption and secure data transfer

Excellent problem-solving and analytical abilities for troubleshooting data integration challenges

Effective communication and documentation skills, with the ability to clearly document technical processes

Preferred experience with AWS Glue, Python, C#, and SparkSQL

Benefits

Health Care Plan (Medical, Dental & Vision)

Retirement Plan (401k, IRA)

Paid Time Off (Vacation, Sick & Public Holidays)