Company:
HCL Global Systems Inc.
Location: New York County
Closing Date: 04/08/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Job Description:
UST is seeking a highly skilled and motivated Spark Scala Developer to join its dynamic team. The Spark Scala Developer will play a critical role in the design, development, deployment, and optimization of data processing applications.
Key Responsibilities:
1. Develop and maintain data processing applications using Spark and Scala.
2. Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
3. Implement test-driven deployment practices to enhance the reliability of applications.
4. Deploy artifacts from lower to higher environments, ensuring a smooth transition.
5. Troubleshoot and debug Spark performance issues to ensure optimal data processing.
6. Work in an agile environment, contributing to sprint planning, development, and delivering high-quality solutions on time.
7. Provide essential support for production batches, addressing issues, and providing fixes to meet critical business needs.
Skills/Competencies:
- Strong knowledge of Scala programming language.
- Excellent problem-solving and analytical skills.
- Proficiency in Spark, including the development and optimization of Spark applications.
- Ability to troubleshoot and debug performance issues in Spark.
- Understanding of design patterns and data structures for efficient data processing.
- Familiarity with database concepts and SQL.
- Good to have: Java and Snowflake.
- Good to have: Experience with test-driven deployment practices.
- Good to have: Familiarity with Python.
- Good to have: Knowledge of Databricks.
- Good to have: Understanding of DevOps practices
UST is seeking a highly skilled and motivated Spark Scala Developer to join its dynamic team. The Spark Scala Developer will play a critical role in the design, development, deployment, and optimization of data processing applications.
Key Responsibilities:
1. Develop and maintain data processing applications using Spark and Scala.
2. Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
3. Implement test-driven deployment practices to enhance the reliability of applications.
4. Deploy artifacts from lower to higher environments, ensuring a smooth transition.
5. Troubleshoot and debug Spark performance issues to ensure optimal data processing.
6. Work in an agile environment, contributing to sprint planning, development, and delivering high-quality solutions on time.
7. Provide essential support for production batches, addressing issues, and providing fixes to meet critical business needs.
Skills/Competencies:
- Strong knowledge of Scala programming language.
- Excellent problem-solving and analytical skills.
- Proficiency in Spark, including the development and optimization of Spark applications.
- Ability to troubleshoot and debug performance issues in Spark.
- Understanding of design patterns and data structures for efficient data processing.
- Familiarity with database concepts and SQL.
- Good to have: Java and Snowflake.
- Good to have: Experience with test-driven deployment practices.
- Good to have: Familiarity with Python.
- Good to have: Knowledge of Databricks.
- Good to have: Understanding of DevOps practices
Share this job
Useful Links