Data Engineer

Data Engineer (Databricks)
We are seeking a Data Engineer to play a key role in a major Data Engineering initiative at a leading enterprise-level telecommunications provider.  This Data Engineer should have experience with Databricks Asset Bundling for CI/CD automation, conducting code reviews for adherence to development standards, and be comfortable participating in architectural decisions and technical solution design for this project. 
 
Data Engineer Qualifications:

• 5+ years of experience in data engineering with at least 3 years focused on Databricks platform
• Hands-on experience with Databricks Asset Bundles (DABs) for CI/CD automation
• Proven experience implementing Medallion architecture patterns in production environments
• Strong proficiency in Databricks platform capabilities and data processing frameworks
• Experience with data lake management concepts and transactional data operations

Nice to Have Skills:

• Databricks certified professional credentials (Data Engineer Associate/Professional)
• Experience with real-time streaming data processing using Databricks Structured Streaming
• Knowledge of machine learning workflows and MLOps practices within Databricks
• Experience with Infrastructure as Code tools and deployment automation
• Familiarity with containerization technologies and modern DevOps practices
• Previous consulting or managed services experience
• Experience with data visualization tools and business intelligence platforms
• Knowledge of graph algorithms and network analysis techniques

Data Engineer responsibilities: 

• Design and implement robust data pipelines using Databricks platform capabilities
• Develop and maintain ETL/ELT processes following best practices for performance and reliability
• Build and optimize data transformations within Databricks environments
• Design and implement graph data integration patterns and relationship mapping strategies
• Implement and manage Databricks Asset Bundles (DABs) for streamlined deployment workflows
• Configure and maintain CI/CD pipelines using Asset Bundles for development, staging, and production environments
• Participate in architectural decisions and technical solution design
• Stay current with Databricks platform updates and emerging data engineering technologies

TSG is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
#LI-RA1