Senior Data Engineer
Emeryville, CA 94608
Volume of data will probably be in the upper hundred millions of rows.
This person will need to transform data into different data formats and perform discovery and mapping of the data.
We are looking for a senior engineer who is able to build tooling and processes that allow junior engineers to be more productive.
The qualified candidate must have advanced SQL, Apache Spark, and general database skills and strong knowledge of
Parquet, Hadoop or Amazon Elastic Map Reduce (EMR), Python, and general working knowledge of Amazon Web Services (AWS).
We have plenty of general SQL and development talent but need the senior-level ability to optimize this talent with their knowledge and experience in building automated data pipelines.