Company:
Diverse Lynx
Location: Plano
Closing Date: 26/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Role: Java spark with AWS (Snow flake exposure required)
Location: Plano TX / Wilmington DE
Duration: Long Term
Job Description
Design, develop, and maintain scalable data pipelines using Apache Spark and Java.
Implement data processing workflows and ETL processes to ingest, transform, and store large volumes of data.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune data processing jobs for performance and cost-efficiency.
Ensure data quality, integrity, and security across all data pipelines and storage solutions.
Develop and maintain data models, schemas, and documentation.
Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.
Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue. Snowflake
Experience with SQL and NoSQL databases.
CICd/ Jules /Spinnaker
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Plano TX / Wilmington DE
Duration: Long Term
Job Description
Design, develop, and maintain scalable data pipelines using Apache Spark and Java.
Implement data processing workflows and ETL processes to ingest, transform, and store large volumes of data.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune data processing jobs for performance and cost-efficiency.
Ensure data quality, integrity, and security across all data pipelines and storage solutions.
Develop and maintain data models, schemas, and documentation.
Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.
Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue. Snowflake
Experience with SQL and NoSQL databases.
CICd/ Jules /Spinnaker
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Share this job
Useful Links