Data Engineer (Cloud)

Kingfisher Recruitment (Singapore) Pte Ltd

-

pure blood data engineer
AWS, cloud - S3, Hive engine, EMR, MapR, pyspark

ingest 10 - 20 types of data for 3 pple
design, build pipelines, own it, maintain it, document

small data sets - 100GBs of data weekly
a dozen data set now, will triple in next 18months
100 types of datasets from providers, each about 1MB