Lead Data Engineer

A Lead Data Engineer will play a crucial role in turning vast amounts of complex data into valuable insights that will drive business decisions and innovation. You will work closely with cross-functional teams, including engineers, analysts, and business stakeholders, to identify opportunities, design experiments, build predictive models, feature engineering, and develop data-driven solutions. The ideal candidate should have a strong background in statistics, machine learning, programming, and data analysis, along with excellent communication and problem-solving skills. A background in financial systems is a plus, as is development experience in an iterative, Agile/SCRUM environment.

Analyze large, complex datasets to identify patterns, trends, and insights that can be used to enhance business strategies and decision-making processes
Design and implement statistical models, machine learning algorithms, feature engineering, and data mining techniques to develop predictive models and extract actionable insights from data
As a lead data engineer, implement large, complex enterprise data solutions from the ground up to drive innovation
Recommend new technologies, tools and standards to improve efficiency and productivity
Research, POC, test, and implement new technologies to support the application and data solutions architecture.
The core skill set will be centered around data science, data engineering, machine learning, AI modeling: Python, SQL, Spark, Snowflake, JavaScript, visualizations, and cloud computing
Review and audit design solution, and mentor software engineers.
Other duties as assigned.

Excellent communication and teamwork skills
7+ years hands-on experience in Python or R
7+ years of experience in SQL, Spark, Airflow, data modeling, and ETL/Data pipeline
3+ years of hands-on experience in data visualization using tools like Tableau, Power BI
3+ years of experience in machine learning and feature engineering
Solid hands-on cloud computing experience (AWS, Microsoft Azure, GCP)
Solid experience using event and data streaming tools such as Apache Kafka, Kinesis or any related technology
Solid experience in troubleshooting and debugging is critical.
Solid experience designing and building data APIs
Experience using frontend technologies such HTML5/CSS, JavaScript is a plus
Solid experience in Agile/SCRUM development methodologies and best practices