Home > Jacksonville jobs > Jacksonville computer/technical

Posted: Saturday, September 2, 2017 12:36 AM

The Big Data Engineer will have experience with data transport within Apache Hadoop Big Data architecture and experience with ELT specialty Data wrangling and gest data from various structured data sources into Hadoop and other distributed Big Data systems (HDFS, HBase, Hive, Scoop).Develop and support the sustainment and delivery of an automated ETL pipeline using Java, and other scripting tools (MapReduce, Python, Pig).Validate data that is extracted from structured data inputs, databases, and other repositories using scripts and other automated capabilities, logs, and queries.Enrich and transform extracted data, as required. Monitor and report the data flow through the ETL process.Perform data extractions, data purges, or data fixes in accordance with current internal procedures and policies.Track development and operational support via user stories and decomposed technical tasks in a provided issue tracking software, including GIT, Maven, and JIRA.7 years overall IT experience and 3 years of toolset includingHadoop:based Data Lake ecosystemApache SparkScala Programming LanguageApache ScoopHiveEnterprise Data Warehouse Development experienceETL development experience using a major ETL tool (SSIS, Informatica, IBM, Oracle, etc)Batch, Near:Real:Time and Micro:batch Integration TechniquesChange data Capture (CDC) techniquesStrong analytical and coding skillsExcellent communication skillsMicrosoft Azure HD InsightsApache OozieApache ParqueApache HbaseApache Thrift ServerHadoop Management Tools (Ranger, Falcon, Ambari)Metadata Mgt Tools (HCatalog, HiveMetastore, Allation)Change data Capture (CDC) techniquesHands:on SQL Server Integration Services (SSIS) experienceMulesoft Integration BusBig Data integration solutioning, cost modeling and capacity planningREST API developmentBI Reporting Tool Experience (MicroStrategy, Cognos, SSAS, Tableau, Qlikview, etc)Advanced Analytics Tool experience (SAS, SPSS, R etc)Data Wrangling Tools (Alteryx, Trifacta, Paxata)Logical, Physical and Dimensional Data ModelingAcosta Sales and Marketing is an Equal Opportunity Employer


• Location: Jacksonville

• Post ID: 18404292 jacksonville is an interactive computer service that enables access by multiple users and should not be treated as the publisher or speaker of any information provided by another information content provider. © 2017