Job Description

Data Engineer

Java, Scala, ETL, Databricks, Healthcare domain experience

As a Data Engineer, you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards.

• Design, implement, and manage data flows that integrate information from various sources into a common pool, implementing data pipelines based on ELT and ETL models.
• Build dashboards and query tools for cross-functional teams in the organization.
• Develop datasets and models to meet the requirements of analysts and key stakeholders, optimizing query compute and data storage patterns for cost and performance.
• Work closely with engineering teams to troubleshoot issues with APIs and data exchanges between multiple systems.

• 5+ years of Data Engineering experience, including strong expertise in Java programming along with Scala-an understanding of Python/PySpark/SparkSQL would be advantageous.
• Extensive hands-on experience working with large, structured/unstructured datasets using partitioned cloud storage architecture and query engines such as Spark and Delta Lake.
• Experience in designing, developing, deploying, and testing in Databricks is preferred.
• Experience with big data pipelines/DAG tools like Airflow and dbt is required.
• Strong SQL experience, specifically in writing complex, highly optimized queries across large volumes of data.

• Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
• Technical certification in multiple technologies is desirable.

Job Tags

Similar Jobs