Other Jobs
Loading...

Big Data Consultant

Sorry, looks like this job is no longer open 😔

Check out other job openings on our job board!

View more
Company
Open Systems Technologies
Job location
Mississauga, CA
Salary
Undisclosed
Posted
Hosted by
Adzuna

Job details

We are looking for Bigdata consultant for a contract Hybrid role in Mississauga. The ideal candidate will have a passion cum extensive experience in large scale data handling, rich expertise on BigData Transformation programs right from Architecture to Maintenance. If you have relevant skills .Please apply with a copy of your updated resume and contact details. Key Responsibilities: • Translate high-level & functional requirements, Data Modelling (dimensional, semi structured, transactional use cases) to technical design. • Develop batch & real time data ingestion Pipelines involving wide range of technologies like Spark, Hadoop, Hive, Middleware etc. • Develop programs to migrate Historical Data from legacy platforms to the BigData platform. • Participate in UAT/ SIT Test cycles, Release cycles, triage and resolve issues. • Perform Code reviews, test case reviews and ensure Functional & Non-Functional requirements. • Analyse Platform & Software version upgrades, evaluate new tools and technologies for handling the growing Data. Required Skills: • Experience: 6 to 8 years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems. • Exp with Designing, creating, optimizing Cloudera platform. Design, develop, and optimize scalable distributed data processing pipelines using Apache Spark, Scala, Hadoop ecosystem tools such as Hive, HDFS, and YARN. • Real-Time Data Streaming: Experience with streaming platforms such as Apache Kafka or Spark Streaming.
Get the freshest news and resources for developers, designers and digital creators in your inbox each week
Start Free Trial
Connect
RSSFacebookInstagramTwitter (X)
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
© 2000 - 2024 SitePoint Pty. Ltd.