C

AWS Databricks Engineer

  • Credence
  • McLean, United States
  • On-site
  • Full-Time
  • $155,000 - 185,000 per year
  • Posted 12 days ago
Other software

Salary: $155,000 - 185,000 per year

Requirements:

  • U.S. citizenship and the ability to obtain and maintain a Secret clearance
  • Bachelors or masters degree in computer science, data engineering, information systems, engineering, or a related technical field
  • Hands-on experience in data engineering, cloud engineering, or a related technical role
  • Experience building and maintaining production data solutions with Databricks, Apache Spark, and PySpark
  • Strong experience with AWS data services, including S3, Glue, RDS, Redshift, Lambda, IAM, and CloudWatch
  • Strong understanding of ETL/ELT processes, data lake and lakehouse architectures, data modeling, and large-scale data processing
  • Hands-on experience with Delta Lake, SQL, Python, and Spark-based data processing
  • Experience developing, scheduling, monitoring, and troubleshooting production data pipelines and workflows
  • Experience with Git and CI/CD platforms such as GitLab, GitHub Actions, Jenkins, or AWS CodePipeline
  • Understanding of cloud security, identity and access management, encryption, and secure data-handling practices
  • Strong communication skills and a client-oriented approach, with the ability to work across technical and non-technical teams
  • Preferred: Active Secret clearance
  • Preferred: CompTIA Security+ certification
  • Preferred: Databricks certification(s)
  • Preferred: Experience implementing Databricks lakehouse and medallion architectures using Bronze, Silver, and Gold layers
  • Preferred: Experience with Unity Catalog, Delta Live Tables, Databricks Workflows, or similar orchestration and governance tools
  • Preferred: Strong Python skills and experience with data engineering libraries and frameworks such as PySpark, Pandas, and Pydantic
  • Preferred: Experience with Infrastructure as Code tools such as Terraform, OpenTofu, AWS CDK, or CloudFormation
  • Preferred: AWS and/or Databricks certifications, such as AWS Certified Data Engineer – Associate, AWS Certified Solutions Architect, or Databricks Certified Data Engineer credentials
  • Preferred: Knowledge of federal cybersecurity, RMF, FedRAMP, or other government compliance frameworks
  • Preferred: Experience delivering cloud-native data solutions for federal government or other highly regulated environments

Responsibilities:

  • Design, build, and optimize scalable data pipelines and processing workflows using Databricks, Apache Spark, PySpark, and Delta Lake
  • Design and implement modern lakehouse solutions using Databricks and AWS services, applying Bronze, Silver, and Gold medallion layers to enhance data quality, governance, lineage, performance, and accessibility
  • Build and maintain ETL/ELT pipelines that integrate structured, semi-structured, and unstructured data across AWS services such as S3, Glue, RDS, Redshift, and Lambda
  • Develop efficient data transformations using SQL, Python, and PySpark
  • Optimize Spark workloads, queries, clusters, and storage configurations for performance, reliability, and cost efficiency
  • Implement data quality, cataloging, lineage, governance, and access-control practices across Databricks and AWS environments, including Unity Catalog where applicable
  • Automate data platform deployments and workflows using Infrastructure as Code, CI/CD pipelines, Git-based development, and AWS-native deployment tools
  • Collaborate with data engineers, software engineers, data scientists, cloud engineers, and mission stakeholders to turn business and technical needs into production-ready data solutions
  • Write clean, maintainable, well-documented code in accordance with engineering, security, and federal development standards
  • Contribute to code reviews, testing, troubleshooting, and technical design documentation

Technologies:

  • AI
  • AWS
  • Lambda
  • Redshift
  • Architect
  • CI/CD
  • Cloud
  • CloudWatch
  • Databricks
  • ETL
  • Git
  • GitHub
  • GitLab
  • IAM
  • Jenkins
  • Python
  • PySpark
  • SQL
  • Security
  • Spark
  • Terraform
  • Unity
  • pandas
  • GameDev
  • DevOps
  • Support

More:

We are Credence, a company delivering AI, cloud, cybersecurity, and modernization solutions for federal agencies and missions in national security, health, and humanitarian work. Our 1,700-plus team members include more than 1,500 AI and data experts, and we hold over 100 prime contracts. We have been named a Washington Post Top Workplace for six consecutive years and recognized among the Inc. 5000 Fastest Growing Private Companies in 13 of the past 14 years. We welcome employees who want to grow, contribute to positive change, and take on meaningful federal challenges. We are hiring an AWS Databricks Engineer for our growing AI and Automation practice to develop secure, high-performance cloud data capabilities. The annual salary range is $155,000–$185,000, with compensation based on experience, education, certifications, skills, and qualifications. Benefits include medical, dental, and vision coverage; retirement plans; life insurance; paid vacation, sick leave, and holidays; family leave; short- and long-term disability; training and development; and wellness resources.

last updated 46 week of 2026

Apply on DevITjobs

You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.

Get new jobs like this by email

Other software · United States

Free. Confirm by email first; unsubscribe anytime in one click.

Similar jobs

AWS Databricks Engineer at Credence — McLean, United States | Peter Nowak