Data Engineer

Sanderson Recruitment

Dublin

Data Engineer Sanderson have teamed up with an electronics and semiconductor company to recruit a Data Engineer . Our client is looking for a full stack developer to support the data engineering activities. The ideal candidate will have a well-rounded experience in all aspects around data collection from various sources, cleaning and loading into databases, designing, and creating of the databases. Skills Python Extract metrics for analytics and schedule these scripts to run at regular intervals to augment existing datasets with derived analytics. Experience using SQAlchemy with demonstrated abilities to read and load datasets to and from databases using SQLAlchemy libraries. Demonstrated capabilities for the importing from files and exporting to propriety file formats to retain structured intermediate datasets including JSON formats for Read/Save/Transmit/Transform/Create etc. Database o ETL (Extract, Transform, Load) data, the ability to design and create meaningful relational tables with a balance in abstraction and query performance for huge datasets. A working knowledge of Database/SQL Query optimizations, performance Tuning and database Backup/Restore procedures is a must. Data engineering Demonstrated abilities on ETL (Extract, Transform, Load). Be prepared to solve a sample use case presented during the screening process. Create your algorithm in plain English. Git A high level of git proficiency is required. You should be able to perform all the following task from a command shell. Create a new repository Clone from an existing repository on a git server Create Branches and Merge branches. Create tags Pull Update and Push You must be able to clearly explain what all the above steps does and achieve. Webserver The dashboard application is built of a web server on Linux and a working knowledge of web servers is required including Nginx, Apache2 and the basics of HTTP or HTTPS, style sheets and web pages. Knowledge of the inner workings of Grafana will be advantageous. Linux A working knowledge of Ubuntu/Debian Servers would be a huge advantage. A working knowledge of basic Shell Scripting is required and the use of a Cron Scheduler to launch Python scripts with. For more information, please apply with full CV to Kirtee Issur-Garvin at Sanderson (Kirtee.Issur-).

665 days ago