Databricks Engineer

Job Summary

Digital Dhara LLC is seeking a skilled Databricks Engineer to work on‑site in Five Corners, Hudson County, NJ. This hybrid role focuses on designing, implementing, and managing the Databricks platform while optimizing performance, security, and cost.

Key Responsibilities

• Design, build, and maintain Databricks platform architecture, including clusters, jobs, and workspace configurations.
• Perform platform administration tasks such as access control, security hardening, cost optimization, and performance tuning.
• Develop, test, and optimize DBT models, macros, and transformation pipelines.
• Create scalable ETL/ELT pipelines using Databricks with PySpark and SQL.
• Integrate DBT workflows with Databricks and orchestration tools (e.g., Airflow, Azure Data Factory).
• Monitor system health, troubleshoot issues, and implement best‑practice governance.
• Collaborate with data scientists, analysts, and engineering teams to deliver reliable data solutions.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
• 3+ years of hands‑on experience with Databricks, Spark, and cloud platforms (AWS, Azure, or GCP).
• Proficiency in PySpark, SQL, and DBT (data build tool) development.
• Strong understanding of data warehousing concepts, ETL/ELT design, and orchestration frameworks.
• Experience with platform security, IAM, and cost‑management strategies.
• Excellent problem‑solving, communication, and teamwork skills.

Preferred Skills

• Certifications such as Databricks Certified Data Engineer or Cloud Provider certifications.
• Knowledge of CI/CD pipelines for data engineering.
• Familiarity with containerization (Docker) and Kubernetes.

Compensation

Salary: $131,053.70 per year (fixed).

How to Apply

Submit your resume and a brief cover letter highlighting your Databricks experience through the WeHired.Agency portal.

Frequently Asked Questions

What technologies will I work with as a Databricks Engineer?

You will work with Databricks, Apache Spark, PySpark, SQL, DBT, and cloud services such as AWS, Azure, or GCP, plus orchestration tools like Airflow.

Is this position fully remote or onsite?

The role is hybrid, requiring onsite presence in Five Corners, Hudson County, NJ, with flexibility for remote work as needed.

What is the salary for this role?

The position offers a fixed annual salary of $131,053.70.