+1 844 678 44 27


Company : Optghar
Req/job Title : Big Data Developer
Job Ref No : 7769
Post Date : 09/15/2022
Country : USA
Job State/Province : North Carolina
Job City : Charlotte
PrimarySkill : BIG DATA Jobs
Experience : 0 - 5
OtherSkill :
Subject : Urgent Requirement of Big Data Developer
Description :
Job Description:
Objectives of this Role
·        Develop and implement data pipelines that extracts, transforms and loads data into an information product that helps to inform the organization in reaching strategic goals
·        Work on ingesting, storing, processing and analyzing large data sets
·        Create scalable and high-performance web services for tracking data
·        Translate complex technical and functional requirements into detailed designs 
·        Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented
·        Serve as a mentor to junior staff by conducting technical training sessions and reviewing project outputs

Daily and Monthly Responsibilities
·        Develop and maintain data pipelines implementing ETL processes
·        Take responsibility for Hadoop development and implementation
·        Work closely with a data science team implementing data analytic pipelines
·        Help define data governance policies and support data versioning processes
·        Maintain security and data privacy working closely with Data Protection Officer internally
·        Analyze a vast number of data stores and uncover insights

Skills and Qualifications
·        Experience in Python, Spark and Hive
·        Understanding of data warehousing and data modeling techniques
·        Knowledge of industry-wide analytical and visualization tools (Tableau and R)
·        Strong data engineering skills on the Azure Cloud Platform is essential
·        Streaming frameworks like Kafka
·        Knowledge of core Java, Linux, SQL, and any scripting language 
·        Good interpersonal skills and positive attitude

Preferred Qualifications
·        Expertise in ETL methodology of Data Extraction, Transformation and Load processing in corporate wide ETL solution design using Data Stage.