Company:
Genesis10
Location: Inver Grove Heights
Closing Date: 09/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Genesis10 is seeking a Software Engineer: IV (Lead) for a contract with our client in Inver Grove Heights, MN. 100% Remote.
Job Description:
We are seeking an experienced Confluent Cloud Kafka Developer to design, develop, and manage scalable, real-time data streaming solutions using Apache Kafka on Confluent Cloud. The ideal candidate will work with data engineering teams to architect streaming data pipelines, integrate diverse data sources, and optimize Kafka for high-performance applications. This role requires strong expertise in Apache Kafka, Confluent Cloud, and distributed streaming platforms, with a focus on real-time integrations.
Key Responsibilities:
Develop, implement, and manage streaming data pipelines using Confluent Kafka and Apache Flink.
Collaborate with data engineering teams to integrate streaming solutions with existing data platforms such as AWS and Snowflake.
Design, build, and maintain real-time data pipelines and ensure high data quality, integrity, and reliability.
Utilize Terraform to manage and automate code deployments on AWS or other cloud environments.
Develop and maintain CI/CD pipelines for deploying and managing Kafka clusters and related infrastructure.
Collaborate with development, DevOps, and data science teams to understand data needs and deliver optimal solutions.
Provide support and guidance on Kafka-related issues and best practices to other teams.
Stay updated with the latest Kafka and streaming technologies and provide recommendations for improvements.
Required Basic Qualifications:
3+ years of experience in software development, with a strong focus on Apache Kafka and distributed systems.
2+ years of experience in Python (preferred) or Java for building Kafka applications
Proven experience with Confluent Kafka, including Kafka Connect, Schema Registry, Apache Flink and KSQL.
Experience with Infrastructure as Code (IaC) tools, particularly Terraform.
Hands-on experience with AWS services (e.g., EC2, S3, IAM, Lambda) and Snowflake.
Solid understanding of data integration, ETL processes, and data pipeline orchestration.
Experience with operational monitoring and performance optimization of streaming pipelines.
Ability to troubleshoot and resolve complex technical issues related to Kafka and its ecosystem.
Strong analytical and problem-solving skills, with attention to detail.
Excellent verbal and written communication skills.
Ability to work effectively in a team environment and collaborate with cross-functional teams.
Preferred Qualifications:
2+ years of experience working with Confluent Cloud and implementing Kafka-based solutions.
Experience with other data streaming tools and platforms.
Familiarity with DevOps tools and practices, including CI/CD, Docker, and Kubernetes.
Certification in AWS, Kafka, or related technologies.
Compensation:
Hourly W2 pay rate $85.00-$100.00
We have access to additional contract, contract-to-hire, and direct hire positions with various rate ranges.
If you have the described qualifications and are interested in this exciting opportunity, apply today!
Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:
Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
Behavioral Health Platform
Medical, Dental, Vision
Health Savings Account
Voluntary Hospital Indemnity (Critical Illness & Accident)
Voluntary Term Life Insurance
401K
Sick Pay (for applicable states/municipalities)
Commuter Benefits (Dallas, NYC, SF)
Remote opportunities available
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Genesis10 is seeking a Software Engineer: IV (Lead) for a contract with our client in Inver Grove Heights, MN. 100% Remote.
Job Description:
We are seeking an experienced Confluent Cloud Kafka Developer to design, develop, and manage scalable, real-time data streaming solutions using Apache Kafka on Confluent Cloud. The ideal candidate will work with data engineering teams to architect streaming data pipelines, integrate diverse data sources, and optimize Kafka for high-performance applications. This role requires strong expertise in Apache Kafka, Confluent Cloud, and distributed streaming platforms, with a focus on real-time integrations.
Key Responsibilities:
Develop, implement, and manage streaming data pipelines using Confluent Kafka and Apache Flink.
Collaborate with data engineering teams to integrate streaming solutions with existing data platforms such as AWS and Snowflake.
Design, build, and maintain real-time data pipelines and ensure high data quality, integrity, and reliability.
Utilize Terraform to manage and automate code deployments on AWS or other cloud environments.
Develop and maintain CI/CD pipelines for deploying and managing Kafka clusters and related infrastructure.
Collaborate with development, DevOps, and data science teams to understand data needs and deliver optimal solutions.
Provide support and guidance on Kafka-related issues and best practices to other teams.
Stay updated with the latest Kafka and streaming technologies and provide recommendations for improvements.
Required Basic Qualifications:
3+ years of experience in software development, with a strong focus on Apache Kafka and distributed systems.
2+ years of experience in Python (preferred) or Java for building Kafka applications
Proven experience with Confluent Kafka, including Kafka Connect, Schema Registry, Apache Flink and KSQL.
Experience with Infrastructure as Code (IaC) tools, particularly Terraform.
Hands-on experience with AWS services (e.g., EC2, S3, IAM, Lambda) and Snowflake.
Solid understanding of data integration, ETL processes, and data pipeline orchestration.
Experience with operational monitoring and performance optimization of streaming pipelines.
Ability to troubleshoot and resolve complex technical issues related to Kafka and its ecosystem.
Strong analytical and problem-solving skills, with attention to detail.
Excellent verbal and written communication skills.
Ability to work effectively in a team environment and collaborate with cross-functional teams.
Preferred Qualifications:
2+ years of experience working with Confluent Cloud and implementing Kafka-based solutions.
Experience with other data streaming tools and platforms.
Familiarity with DevOps tools and practices, including CI/CD, Docker, and Kubernetes.
Certification in AWS, Kafka, or related technologies.
Compensation:
Hourly W2 pay rate $85.00-$100.00
We have access to additional contract, contract-to-hire, and direct hire positions with various rate ranges.
If you have the described qualifications and are interested in this exciting opportunity, apply today!
Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:
Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
Behavioral Health Platform
Medical, Dental, Vision
Health Savings Account
Voluntary Hospital Indemnity (Critical Illness & Accident)
Voluntary Term Life Insurance
401K
Sick Pay (for applicable states/municipalities)
Commuter Benefits (Dallas, NYC, SF)
Remote opportunities available
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Share this job
Useful Links