Information Technology - BI Jobs

Data Engineer

Job Description

A great new position is available with top company for a Data Engineer in Sandton, Johannesburg.

Responsibilities:

• Understand each company’s data sets

• Understand both the business and the data analysis goals

• Advise on data architecture

• Maintain analytics servers (Spark, Jupyter, PySpark)

• Ensure effective infrastructure for processing large volumes of transactional data (Hadoop)

• Assist in the preparation analytical datasets for data mining

• Ensure security on data platforms

• ETL

• Assess scalability and roadmap technology

• Document the planning, implementation and operation of the data platform

Qualifications and Experience:

• ETL experience with SSIS, SAP Data Services, IBM, Pentaho or equivalent.

• Experience with open source big data infrastructure: Hadoop, Spark, Mongodb, Hive, HBase.

• Experience preparing dataset for consumption by BI tools and analysts.

• Comfortable with Linux command line.

• Git version control.

• Fluent with both relational algebra and MapReduce logic.

• Experience with implementing/utilizing multithreaded data processing.

• Ability to interrogate large data files on the fly.

• Advantageous:

• Postgraduate Degree in computer science, physics, applied mathematics, mathematics or other computational, data-intensive field.

• Servers and networking

• Python

• Experience with BI tools

• Virtualization technologies (Docker / Vagrant)

• Microsoft Azure or other cloud platform

Interested candidates can forward their comprehensive written applications to the following e-mail: it. jobs(at)hireresolve.co.za or fax to: 086 600 7977, you can also contact Nikita on 011 807 8064

Correspondence will only be conducted with short listed candidates. Should you not hear from us within 3 working days after the closing date, please consider your application unsuccessful.

Hire Resolve offers a R1000 for any candidate that is referred and placed through Hire Resolve. Hire Resolve also offers a R1000 job spec fee for any referral that results in a placement through Hire Resolve. If your company is looking for any IT, Finance or Engineering staff, please email us at jobspec@hireresolve.co.za with the company name, a contact person and contact email or number of the person doing the hiring. We will keep the referral strictly confidential.

or email us: it.jobs(at)hireresolve.co.za