Azure Databricks Data Engineer AND TERRADATA
Plano, TX (On-Site)
Job Description:
Azure Databricks Data Engineer- Plano TX
I hope all is well! I wanted to reach out and see if you were interested in a Databricks Data Engineer role based in Plano, TX. This would be a long term contract and would require to come onsite 3x a week in Plano. They are needing someone with strong knowledge of Teradata for a migration to databricks and will need to be very experienced in Python. If you are interested, please send me your updated resume and best phone number.
REQUIRED SKILLS AND EXPERIENCE
• 10+ years in data engineering
• 4+ years working with Azure cloud technologies (Databricks, ADF, Synapse, Event Hubs).
• Strong hands-on experience with Teradata (Legacy RDBMS) migration to Azure
• Expertise with Teradata Tools and Utilities (TPT, BTEQ, QG, NOS)
-Spark performance tuning
-Databricks Cluster Optimization
-Query optimization (rewriting Teradata SQL for Spark efficiency)
-Data Storage Optimization
-Cost Optimization in Azure
• Expertise in Bronze, Silver, and Gold data architecture for efficient data processing.
• Proficiency in Informatica, ADO, SQL, Python, and Spark (PySpark) for ETL/ELT and transformation.
• Experience designing and optimizing Azure DevOps (ADO) CI/CD pipelines.
• Background in real-time data streaming (Kafka,Tibco, Event Hubs) and supporting AI/ML workloads in production.
• Strong understanding of Agile development methodologies.
DESIRED SKILLS
• Proficiency in Informatica, ADO, SQL, Python, and Spark (PySpark) for ETL/ELT and transformation.
• Experience designing and optimizing Azure DevOps (ADO) CI/CD pipelines.
• Background in real-time data streaming (Kafka,Tibco, Event Hubs) and supporting AI/ML workloads in production.
• Strong understanding of Agile development methodologies.
Drew Darling
Key Skills:
- I hope all is well! I wanted to reach out and see if you were interested in a Databricks Data Engineer role based in Plano, TX. This would be a long term contract and would require to come onsite 3x a week in Plano. They are needing someone with strong knowledge of Teradata for a migration to databricks and will need to be very experienced in Python. If you are interested, please send me your updated resume and best phone number. REQUIRED SKILLS AND EXPERIENCE • 10+ years in data engineering • 4+ years working with Azure cloud technologies (Databricks, ADF, Synapse, Event Hubs). • Strong hands-on experience with Teradata (Legacy RDBMS) migration to Azure • Expertise with Teradata Tools and Utilities (TPT, BTEQ, QG, NOS)