Job Search
Categories
Information Technology - BI Jobs
Data Engineer
Job Information | |
---|---|
Location | BI Jobs in Johannesburg |
Salary | R550k |
Job Type | Permanent |
Education | Relevant diploma or degree from a recognised tertiary institution |
Experience | 4+ years’ experience |
Reference | NDC022 |
it.jobs(at)hireresolve.co.za | |
Fax | 0866007977 |
Job Description
A great new position is available with top company for a Data Engineer in Sandton, Johannesburg.
Responsibilities:
• Understand each company’s data sets
• Understand both the business and the data analysis goals
• Advise on data architecture
• Maintain analytics servers (Spark, Jupyter, PySpark)
• Ensure effective infrastructure for processing large volumes of transactional data (Hadoop)
• Assist in the preparation analytical datasets for data mining
• Ensure security on data platforms
• ETL
• Assess scalability and roadmap technology
• Document the planning, implementation and operation of the data platform
Qualifications and Experience:
• ETL experience with SSIS, SAP Data Services, IBM, Pentaho or equivalent.
• Experience with open source big data infrastructure: Hadoop, Spark, Mongodb, Hive, HBase.
• Experience preparing dataset for consumption by BI tools and analysts.
• Comfortable with Linux command line.
• Git version control.
• Fluent with both relational algebra and MapReduce logic.
• Experience with implementing/utilizing multithreaded data processing.
• Ability to interrogate large data files on the fly.
• Advantageous:
• Postgraduate Degree in computer science, physics, applied mathematics, mathematics or other computational, data-intensive field.
• Servers and networking
• Python
• Experience with BI tools
• Virtualization technologies (Docker / Vagrant)
• Microsoft Azure or other cloud platform
Interested candidates can forward their comprehensive written applications to the following e-mail: it. jobs(at)hireresolve.co.za or fax to: 086 600 7977, you can also contact Nikita on 011 807 8064
Correspondence will only be conducted with short listed candidates. Should you not hear from us within 3 working days after the closing date, please consider your application unsuccessful.
Hire Resolve offers a R1000 for any candidate that is referred and placed through Hire Resolve. Hire Resolve also offers a R1000 job spec fee for any referral that results in a placement through Hire Resolve. If your company is looking for any IT, Finance or Engineering staff, please email us at jobspec@hireresolve.co.za with the company name, a contact person and contact email or number of the person doing the hiring. We will keep the referral strictly confidential.
or email us: it.jobs(at)hireresolve.co.za