Ab Initio Developer

Charlotte NC – 100% Onsite

Contract

Any Visa that can work on our W2 except OPT

The 6 main skills are:

•             AbInitio

•             UnixShell Scripting

•             Python/ PySpark

•             OraclePL/SQL

•             Teradata

•             CI/CD

About this role:

Join the Home Lending Data and Insightsteam as a Software Engineer 3 - Contingent, where you’ll build, run, andmodernize enterprise data pipelines in a hybrid landscape—spanning on premplatforms (Python, Oracle, Teradata and Ab Initio) and a modern Google Cloudstack (BigQuery, Dataplex). You’ll focus on dependable batch and near real-timeprocessing, operational excellence, and the transition from legacy schedulingand ETL patterns to cloud-native orchestration with Google Cloud Composer,backed by strong data quality standards using Informatica Data Quality

In this role, you will:

•             Buildand maintain scalable batch and near real-time data pipelines using AB Initio,Python, PySpark, PL / SQL and SQL to ingest, transform, and publish curateddatasets across on-prem and Google Cloud platforms.

•             Developand optimize BigQuery transformations and data models, including partitioning,clustering, query optimization, and cost/performance tuning.

•             Supportmodernization/migration from Teradata and Ab Initio workflows to GCP/BigQuery,including logic re-platforming, reconciliation, parallel runs, and controlledcutovers.

•             Implementorchestration and scheduling for pipelines using legacy Autosys while drivingmigration toward Google Cloud Composer (Airflow), including dependencymanagement, retries, SLAs, and backfills.

•             Applydata governance and discovery practices using Dataplex: metadata management,dataset organization, classification support, and ensuring data isconsumption-ready.

•             Buildand operationalize data quality controls using Informatica Data Quality:profiling, rule implementation, thresholds, exception handling, and embeddingquality gates into pipelines.

•             Ensureoperational excellence: monitoring, alerting, runbooks, incident triage/rootcause analysis, and continuous improvements to reliability and performance.

•             Implementsecure data engineering practices: least-privilege access, PII handling/maskingwhere required, retention controls, and audit-friendly documentation.

•             Partnerwith product, analytics, and engineering stakeholders to translate requirementsinto clear data contracts, curated datasets, and maintainable documentation(data dictionaries, reconciliation notes, operational runbooks).

•             Must-have:Use AI-assisted coding tools (e.g., GitHub Copilot, Devin, or similar) toaccelerate development while maintaining strong code review discipline,testing, and secure coding standards.

•             Closelypartner with Product Owners, Architects and Engineers on definition, design,development, integration, testing and support of reliable and reusable Datapipelines.

•             Analyzehighly complex business requirements; generate technical specifications todesign ETL processes.

•             Actas an expert technical resource for analysis and provides critical direction toless experienced staff. Work with team members to provide insight into solvingcomplex problems with middleware while leveraging enterprise and industry bestpractices (including scalability, availability, maintainability, andflexibility).

Required Qualifications:

•             4+years of Data Engineering experience, or equivalent demonstrated through one ora combination of the following: work experience, training, military experience,education

•             4+years PL/SQL and SQL skills with proven experience in Oracle, Teradata, Pythonand/or BigQuery: complex query development, tuning, and debugging.

•             4+years Ab Initio skills with proven experience to build complex graphs, Psets,performance tuning.

•             3+years programming skills in Python; hands-on PySpark for distributed dataprocessing

•             3+years of ETL/ETL design, data warehousing concepts, and data modeling bestpractices

Desired Qualifications:

•             Productionoperations experience: monitoring, SLAs, incident response, root causeanalysis, and performance optimization.

•             Experienceworking in hybrid environments (on-prem + cloud) and supporting datamigration/modernization initiatives.

•             Experiencewith scheduling/orchestration in Autosys and Airflow-based orchestration (CloudComposer direction).

•             Experiencewith Git-based workflows, code reviews, and automated testing practices fordata pipelines.

•             Experiencewith Harness, Jenkins and uDeploy based CICD environments.

•             Practicalexperience using AI-assisted coding tools in daily development to improveproductivity without compromising quality or security.

•             AbInitio development/maintenance experience and/or hands-on migration of AbInitio graphs to modern Spark/SQL patterns.

•             Experiencewith Dataplex and broader data governance concepts (metadata, classification,stewardship, lineage practices).

•             Experiencewith Informatica Data Quality implementation patterns (profiling, rules,scorecards/metrics, exception workflows).

•             Experiencedesigning near real-time patterns (micro-batch/event-driven concepts) andhandling late-arriving/out-of-order data.

•             Familiaritywith GCP operational practices for data workloads (service accounts/IAM basics,job monitoring, quota/cost controls).