MENU
Go Back
Title: Hadoop Developer Location: Columbus,OH Type: Contract The Hadoop Developer works closely with the Big Data / Solution Architect and Data Analytics staff and the support staff of enterprise applications to create specific designs for the linking or movement of data between various enterprise applications and the DW environment. The Hadoop Developer should be very familiar with the capabilities of relevant Hadoop tools, be they specialized tools (e.g. Pig, Hive, Map Reduce, etc), data integration methodologies and tools, (MS SSIS, Informatica, Datastage, etc), generic database functionality (Oracle, Teradata, SQL Server, etc) and also the techniques for dealing with various Big Data structures. The Hadoop Developer will perform or work with: * Business Analyst(s) to understand informational requirements * Data Administrator and Data Stewards to understand information quality definitions and expectations of end users * Data Modeler and Database Designer in the design of target environment data structures * Business System and Data Analyst to understand source system data and structures * Detail design of source to target data mappings * Review proposed mappings with relevant personnel, e.g. Business Analyst, Data Stewards, Business System and Data Analyst * Generate detailed design documentation for the source-to-target transformations * Create test scenarios and be responsible for their execution * Support the efforts of the Data Staging Developer(s) * Work with enterprise application integration personnel to anticipate and resolve data integration issues across applications and technical infrastructures Responsibilities: * Responsible for solutions to be implemented on large data warehouses and proven leadership in providing robust solutions for Analytics, Predictive Analytics, Pattern Recognition, Data Mining, Reporting, Web Analytics and Metadata Management * Develops solution alternatives to meet business needs and considers the costs and risks associated with each alternative * Ensures solutions developed within a domain have been properly implemented in accordance to the agreed upon application architecture. Sets direction for large complex projects and establishes technical solutions for IT project teams * Acts as the subject matter expert for the technology used in the domain to address application integration and infrastructure framework related questions * Prepares and writes request for proposals; evaluates vendor ofering to determine if contract, hardware or software meets quality and cost standards * Work with Data Administrator and Data Stewards to understand information quality definitions and expectations of end users * Work with Data Modeler and Database Designer in the design of target environment data structures * Work with Solution Architect(s), Information Analyst(s) and other team members to understand source system data and data structures * Create and maintain detail design of source to target data mappings * Review proposed mappings with relevant personnel, e.g. Business Analyst, Data Stewards, Business System and Data Analyst * Generate detailed design documentation for the source-to-target transformations * Create test scenarios and be responsible for their execution * Support the efforts of the Data Staging Developer(s) * Work with enterprise application integration personnel to anticipate and resolve data integration issues across applications and technical infrastructures * Stong Communication Skills Qualifications: * Business and system analysis and design fundamentals * Working knowledge of agile and waterfall delivery methodologies * Ability to exploit new opportunities and mitigate potential risks * 3+ years of working experience with data profiling concepts and tools such as: Informatica Data Explorer; SQL Server SQL Profiler; Business Objects Data Insight * 3+ years of working experience with ETL and Business Intelligence Reporting Tools such as: Microsoft SSIS; Informatica Power Center; IBM Datastage; SAP Business Objects; Pig & Hive * 2+ years of experience with Hadoop technologies - HortonWorks Hadoop, Pig, Hive, MapR, Oozie, Ambari, etc * 4+ years of working experience developing solutions with Java * 3+ years of experience with data architecture, data modeling and data cleansing * High level understanding of XML schema and database structures, theories, principles and practices and development methodologies (e.g. RUP, UML) * Knowledge of Structured Query Language (SQL) * Microsoft Excel knowledge to include pivot tables, graphs and presentation layers * Experience designing end to end maintenance and storage strategies for corporate reference data
Key Skills:
Hadoop Developer Location: Columbus,OH
Job Type:
Contract
Title: Hadoop Developer Location: Columbus,OH Type: Contract The Hadoop Developer works closely with the Big Data / Solution Architect and Data Analytics staff and the support staff of enterprise applications to create specific designs for the linking or movement of data between various enterprise applications and the DW environment. The Hadoop Developer should be very familiar with the capabilities of relevant Hadoop tools, be they specialized tools (e.g. Pig, Hive, Map Reduce, etc), data integration methodologies and tools, (MS SSIS, Informatica, Datastage, etc), generic database functionality (Oracle, Teradata, SQL Server, etc) and also the techniques for dealing with various Big Data structures. The Hadoop Developer will perform or work with: * Business Analyst(s) to understand informational requirements * Data Administrator and Data Stewards to understand information quality definitions and expectations of end users * Data Modeler and Database Designer in the design of target environment data structures * Business System and Data Analyst to understand source system data and structures * Detail design of source to target data mappings * Review proposed mappings with relevant personnel, e.g. Business Analyst, Data Stewards, Business System and Data Analyst * Generate detailed design documentation for the source-to-target transformations * Create test scenarios and be responsible for their execution * Support the efforts of the Data Staging Developer(s) * Work with enterprise application integration personnel to anticipate and resolve data integration issues across applications and technical infrastructures Responsibilities: * Responsible for solutions to be implemented on large data warehouses and proven leadership in providing robust solutions for Analytics, Predictive Analytics, Pattern Recognition, Data Mining, Reporting, Web Analytics and Metadata Management * Develops solution alternatives to meet business needs and considers the costs and risks associated with each alternative * Ensures solutions developed within a domain have been properly implemented in accordance to the agreed upon application architecture. Sets direction for large complex projects and establishes technical solutions for IT project teams * Acts as the subject matter expert for the technology used in the domain to address application integration and infrastructure framework related questions * Prepares and writes request for proposals; evaluates vendor ofering to determine if contract, hardware or software meets quality and cost standards * Work with Data Administrator and Data Stewards to understand information quality definitions and expectations of end users * Work with Data Modeler and Database Designer in the design of target environment data structures * Work with Solution Architect(s), Information Analyst(s) and other team members to understand source system data and data structures * Create and maintain detail design of source to target data mappings * Review proposed mappings with relevant personnel, e.g. Business Analyst, Data Stewards, Business System and Data Analyst * Generate detailed design documentation for the source-to-target transformations * Create test scenarios and be responsible for their execution * Support the efforts of the Data Staging Developer(s) * Work with enterprise application integration personnel to anticipate and resolve data integration issues across applications and technical infrastructures * Stong Communication Skills Qualifications: * Business and system analysis and design fundamentals * Working knowledge of agile and waterfall delivery methodologies * Ability to exploit new opportunities and mitigate potential risks * 3+ years of working experience with data profiling concepts and tools such as: Informatica Data Explorer; SQL Server SQL Profiler; Business Objects Data Insight * 3+ years of working experience with ETL and Business Intelligence Reporting Tools such as: Microsoft SSIS; Informatica Power Center; IBM Datastage; SAP Business Objects; Pig & Hive * 2+ years of experience with Hadoop technologies - HortonWorks Hadoop, Pig, Hive, MapR, Oozie, Ambari, etc * 4+ years of working experience developing solutions with Java * 3+ years of experience with data architecture, data modeling and data cleansing * High level understanding of XML schema and database structures, theories, principles and practices and development methodologies (e.g. RUP, UML) * Knowledge of Structured Query Language (SQL) * Microsoft Excel knowledge to include pivot tables, graphs and presentation layers * Experience designing end to end maintenance and storage strategies for corporate reference data
Key Skills:
